Sharing Content Produced by a Plurality of Client Computers in Communication with a Server

ABSTRACT

A method implemented on a plurality of client computers in communication with a server is disclosed. The plurality of client computers each display common content on an associated display area. The method includes generating messages representing user input received at one client computer of the plurality of client computers, the user input defining content to be shared with the plurality of client computers. The method includes causing the one client computer to transmit the generated messages to the server to elicit transmission of output messages from the server to each of the plurality of client computers, the output messages including information defining the content to be shared. The method includes, in response to receiving output messages from the server at each of the plurality of client computers, displaying the shared content over the common content on the respective display areas on each of the plurality of client computers.

PRIORITY CLAIM AND CROSS REFERENCE TO OTHER APPLICATIONS

This application is a continuation of and claims the benefit of thepriority of U.S. patent application Ser. No. 15/429,041, filed Feb. 9,2017 and entitled “Multi-Party Collaboration over a Computer Network.”Patent application Ser. No. 15/429,041 is a continuation of and claimsthe benefit of the priority of U.S. patent application Ser. No.14/165,296, filed Jan. 27, 2014 and entitled “Method, Apparatus, andSystem for Supporting Multi-Party Collaboration between a Plurality ofClient Computers in Communication with a Server” (now U.S. Pat. No.9,579,572). Patent application Ser. No. 14/165,296 is a continuation ofand claims the benefit of the priority of U.S. patent application Ser.No. 11/694,853, filed Mar. 30, 2007 and entitled “Method, Apparatus,System, Medium, and Signals for Supporting Game Piece Movement in aMultiple-Party Communication” (now U.S. Pat. No. 8,702,505).

This application is related to U.S. patent application Ser. No.11/694,770, filed Mar. 30, 2007, and entitled “Method, Apparatus,System, and Medium for Supporting Multiple-Party Communications” (nowU.S. Pat. No. 8,060,887); U.S. patent application Ser. No. 11/694,817,filed Mar. 30, 2007, and entitled “Method, Apparatus, System, Medium,and Signals for Supporting Pointer Display in a Multiple-PartyCommunication”; U.S. patent application Ser. No. 11/694,865, filed Mar.30, 2007, and entitled “Method, Apparatus, System, Medium, and Signalsfor Intercepting a Multiple-Party Communication” (now U.S. Pat. No.7,950,046); U.S. patent application Ser. 20 No. 11/694,883, filed Mar.30, 2007, and entitled “Method, Apparatus, System, Medium, and Signalsfor Publishing Content Created During a Communication” (now U.S. Pat.No. 7,765,266); and U.S. patent application Ser. No. 11/694,872, filedMar. 30, 2007, and entitled “Method, Apparatus, System, Medium, andSignals for Supporting a Multiple-Party Communication on a Plurality ofComputer Servers” (now U.S. Pat. No. 7,765,261).

The disclosure of each of the above-identified patent applications isincorporated by reference as part of the specification of thisapplication.

BACKGROUND OF THE INVENTION 1. Field of Invention

This invention relates generally to network communications, and moreparticularly to multiple-party communications conducted between clientcomputers in a computer network.

2. Description of Related Art

High bandwidth internet connections enjoyed by many computer users havefacilitated new forms of online collaboration, allowing users to conductmultiple-party communications over an internet connection by sharing acommon view of a displayed page in an internet browser window, forexample. Users may post comments on the displayed page, which may betransmitted to all users, thus facilitating online discussion.

However, such communications suffer from a common problem due to delaysin transmitting posted comments and other information between theparties. In some cases these delays reduce the usefulness of an onlinecommunication since the parties do not feel a presence of otherparticipants in the communication.

Accordingly, there remains a need for communication systems and methodsthat improve a user's experience of such multiple-party communicationsin a computer network.

SUMMARY OF THE INVENTION

In accordance with one aspect of the invention there is provided amethod for moving game piece images displayed on a first client computerin communication with a server in a computer network. The methodinvolves causing at least one game piece image to be displayed on adisplay area of the first client computer, the game piece image havingan image area and an image boundary enclosing the image area. The methodalso involves receiving a cursor movement signal representing a cursormovement produced in response to user input received from a pointingdevice in communication with the first client computer, and determiningwhether a current position of the cursor is within the image boundaryassociated with the game piece image. The method further involvestransmitting a piece movement request message to the server to elicit apiece movement message from the server when the current position of thecursor is within the image boundary, the piece movement request messagerepresenting a desired change in a position of a cursor in response tothe cursor movement signal. The method also involves receiving the piecemovement message at the first client computer, the piece movementmessage representing the change in the position of the cursor, andcausing a change in a position of the game piece image on the displayarea of the first client computer in response to the piece movementmessage.

The method may involve causing a change in a position of a pointerassociated with the cursor and displayed on the display area of thefirst client computer, in response to one of receiving the piecemovement message, and receiving a pointer message from the server, thepointer message representing the change in the position of the cursor.

Determining whether the current position of the cursor may be within theimage boundary may involve determining whether the cursor has crossedthe image boundary.

Determining whether the current position of the cursor may be within theimage boundary may further involve determining whether an actuatorbutton signal has been received while the cursor is within the imageboundary, the actuator button signal being produced in response to useractuation of an actuator button associated with the pointing device.

The method may involve producing the piece movement request message.

Producing the piece movement request message may involve producing amessage may involve a message identifier, a user identifier associatedwith the first client computer, and position coordinates of a currentposition of the cursor.

Producing the piece movement request message may involve producing amessage may involve at least one of an identifier identifying the gamepiece image, and an identifier identifying an owner of the game pieceimage.

Causing the corresponding change in the position of the game piece imagemay involve causing the game piece image to be deleted and redisplayedat the position coordinates representing the position of the cursor.

In accordance with another aspect of the invention there is provided anapparatus for moving game piece images displayed on a first clientcomputer in communication with a server in a computer network. Theapparatus includes provisions for causing at least one game piece imageto be displayed on a display area of the first client computer, the gamepiece image having an image area and an image boundary enclosing theimage area. The apparatus also includes provisions for receiving acursor movement signal representing a cursor movement produced inresponse to user input received from a pointing device in communicationwith the first client computer and provisions for determining whether acurrent position of the cursor is within the image boundary associatedwith the game piece image. The apparatus also includes provisions fortransmitting a piece movement request message to the server to elicit apiece movement message from the server when the current position of thecursor is within the image boundary, the piece movement request messagerepresenting a desired change in a position of a cursor in response tothe cursor movement signal. The apparatus further includes provisionsfor receiving the piece movement message at the first client computer,the piece movement message representing the change in the position ofthe cursor, and provisions for causing a change in a position of thegame piece image on the display area of the first client computer inresponse to the piece movement message.

The apparatus may include provisions for causing a change in a positionof a pointer associated with the cursor and displayed on the displayarea of the first client computer, in response to one of receiving thepiece movement message, and receiving a pointer message from the server,the pointer message representing the change in the position of thecursor.

The provisions for determining whether the current position of thecursor may be within the image boundary may include provisions fordetermining whether the cursor has crossed the image boundary.

The provisions for determining whether the current position of thecursor may be within the image boundary may further include provisionsfor determining whether an actuator button signal has been receivedwhile the cursor is within the image boundary, the actuator buttonsignal being produced in response to user actuation of an actuatorbutton associated with the pointing device.

The apparatus may include provisions for producing the piece movementrequest message.

The provisions for producing the piece movement request message mayinclude provisions for producing a message may include a messageidentifier, a user identifier associated with the first client computer,and position coordinates of a current position of the cursor.

The provisions for producing the piece movement request message mayinclude producing a message may include at least one of an identifieridentifying the game piece image, and an identifier identifying an ownerof the game piece image.

The provisions for causing the corresponding change in the position ofthe game piece image may include provisions for causing the game pieceimage to be deleted and redisplayed at the position coordinatesrepresenting the position of the cursor.

In accordance with another aspect of the invention there is provided anapparatus for moving game piece images displayed on a first clientcomputer in communication with a server in a computer network. Theapparatus includes a processor circuit operably configured to cause atleast one game piece image to be displayed on a display area of thefirst client computer, the game piece image having an image area and animage boundary enclosing the image area. The processor circuit is alsooperably configured to receive a cursor movement signal representing acursor movement produced in response to user input received from apointing device in communication with the first client computer, and todetermine whether a current position of the cursor is within the imageboundary associated with the game piece image. The processor circuit isalso operably configured to transmit a piece movement request message tothe server to elicit a piece movement message from the server when thecurrent position of the cursor is within the image boundary, the piecemovement request message representing a desired change in a position ofa cursor in response to the cursor movement signal. The processorcircuit is further operably configured to receive the piece movementmessage at the first client computer, the piece movement messagerepresenting the change in the position of the cursor, and to cause achange in a position of the game piece image on the display area of thefirst client computer in response to the piece movement message.

The processor circuit may be operably configured to cause a change in aposition of a pointer associated with the cursor and displayed on thedisplay area of the first client computer, in response to one ofreceiving the piece movement message, and receiving a pointer messagefrom the server, the pointer message representing the change in theposition of the cursor.

The processor circuit may be operably configured to determine whetherthe current position of the cursor is within the image boundary bydetermining whether the cursor has crossed the image boundary.

The processor circuit may be operably configured to determine whetherthe current position of the cursor is within the image boundary bydetermining whether an actuator button signal has been received whilethe cursor is within the image boundary, the actuator button signalbeing produced in response to user actuation of an actuator buttonassociated with the pointing device.

The processor circuit may be operably configured to produce the piecemovement request message.

The processor circuit may be operably configured to produce a piecemovement request message may include a message identifier, a useridentifier associated with the first client computer, and positioncoordinates of a current position of the cursor.

The processor circuit may be operably configured to producing the piecemovement request message by producing a message including at least oneof an identifier identifying the game piece image, and an identifieridentifying an owner of the game piece image.

The processor circuit may be operably configured to cause the game pieceimage to be deleted and redisplayed at the position coordinatesrepresenting the position of the cursor.

In accordance with another aspect of the invention there is provided acomputer readable medium encoded with codes for directing a processorcircuit to move game piece images displayed on a first client computerin communication with a server in a computer network. The codes directthe processor circuit to cause at least one game piece image to bedisplayed on a display area of the first client computer, the game pieceimage having an image area and an image boundary enclosing the imagearea. The codes also direct the processor circuit to receive a cursormovement signal representing a cursor movement produced in response touser input received from a pointing device in communication with thefirst client computer and to determine whether a current position of thecursor is within the image boundary associated with the game pieceimage. The codes also direct the processor circuit to transmit a piecemovement request message to the server to elicit a piece movementmessage from the server when the current position of the cursor iswithin the image boundary, the piece movement request messagerepresenting a change in a position of a cursor in response to thecursor movement signal. The codes further direct the processor circuitto receive the piece movement message at the first client computer, thepiece movement message representing the change in the position of thecursor, and to cause a change in a position of the game piece image onthe display area of the first client computer in response to the piecemovement message.

In accordance with another aspect of the invention there is provided acomputer readable signal encoded with codes for directing a processorcircuit to move game piece images displayed on a first client computerin communication with a server in a computer network. The codes directthe processor circuit to cause at least one game piece image to bedisplayed on a display area of the first client computer, the game pieceimage having an image area and an image boundary enclosing the imagearea. The codes also direct the processor circuit to receive a cursormovement signal representing a cursor movement produced in response touser input received from a pointing device in communication with thefirst client computer, and to determine whether a current position ofthe cursor is within the image boundary associated with the game pieceimage. The codes also direct the processor circuit to transmit a piecemovement request message to the server to elicit a piece movementmessage from the server when the current position of the cursor iswithin the image boundary, the piece movement request messagerepresenting a change in a position of a cursor in response to thecursor movement signal. The codes further direct the processor circuitto receive the piece movement message at the first client computer, thepiece movement message representing the change in the position of thecursor, and cause a change in a position of the game piece image on thedisplay area of the first client computer in response to the piecemovement message.

In accordance with another aspect of the invention there is provided amethod for supporting movement of game piece images displayed on firstand second client computers in communication with a server in a computernetwork. The method involves receiving a piece movement request messageat the server from one of the first and second client computers, thepiece movement request message representing a desired change in aposition of a game piece image displayed on respective display areas ofthe first and second client computers. The method further involvestransmitting a piece movement message representing the desired change inthe position of the game piece image to each of the first and secondclient computers when the desired change meets a criterion.

The transmitting may further involve transmitting a pointer message tothe first and second client computers in response to the piece movementrequest message, the pointer message representing the change in theposition of the game piece image provided by the piece movement requestmessage.

Receiving the piece movement request message may involve receiving amessage may involve at least one of a user identifier associated withthe client computer that transmitted the piece movement request messageto the server, an identifier identifying the game piece image, and anidentifier identifying an owner of the game piece image, and thetransmitting may involve transmitting a piece movement message when atleast one of the user identifier associated with the client computerthat transmitted the piece movement request message to the servermatches the identifier identifying the owner of the game piece, and thedesired change in the position of the game piece image identified by theidentifier identifying the game piece image complies with a movementcriteria associated with a game being played between the first andsecond client computers.

Transmitting the piece movement message may involve transmitting amessage including a message identifier, a user identifier associatedwith the first client computer, and position coordinates representing aposition of game piece image.

Transmitting the piece movement message may involve transmitting a copyof the piece movement request message to the first client computer.

The method may involve receiving a piece action request message at theserver from one of the first and second client computers, the pieceaction request message representing a desired action to be performed onthe game piece image, and transmitting a piece action messagerepresenting the desired action to each of the first and second clientcomputers when the desired action meets a criterion.

In accordance with another aspect of the invention there is provided anapparatus for supporting movement of game piece images displayed onfirst and second client computers in communication with a server in acomputer network. The apparatus includes provisions for receiving apiece movement request message at the server from one of the first andsecond client computers, the piece movement request message representinga desired change in a position of a game piece image displayed onrespective display areas of the first and second client computers. Theapparatus also includes provisions for transmitting a piece movementmessage representing the desired change in the position of the gamepiece image to each of the first and second client computers when thedesired change meets a criterion.

The provisions for transmitting may further include provisions fortransmitting a pointer message to the first and second client computersin response to the piece movement request message, the pointer messagerepresenting the change in the position of the game piece image providedby the piece movement request message.

The provisions for receiving the piece movement request message mayinclude provisions for receiving a message including at least one of auser identifier associated with the client computer that transmitted thepiece movement request message to the server, an identifier identifyingthe game piece image, and an identifier identifying an owner of the gamepiece image, and the provisions for transmitting may include provisionsfor transmitting a piece movement message when at least one of the useridentifier associated with the client computer that transmitted thepiece movement request message to the server matches the identifieridentifying the owner of the game piece, and the desired change in theposition of the game piece image identified by the identifieridentifying the game piece image complies with a movement criteriaassociated with a game being played between the first and second clientcomputers.

The provisions for transmitting the piece movement message may includeprovisions for transmitting a message including a message identifier, auser identifier associated with the first client computer, and positioncoordinates representing a position of game piece image.

The provisions for transmitting the piece movement message may includeprovisions for transmitting a copy of the piece movement request messageto the first client computer.

The apparatus may include provisions for receiving a piece actionrequest message at the server from one of the first and second clientcomputers, the piece action request message representing a desiredaction to be performed on the game piece image, and provisions fortransmitting a piece action message representing the desired action toeach of the first and second client computers when the desired actionmeets a criterion.

In accordance with another aspect of the invention there is provided anapparatus for supporting movement of game piece images displayed onfirst and second client computers in communication with a server in acomputer network. The apparatus includes a processor circuit operablyconfigured to receive a piece movement request message at the serverfrom one of the first and second client computers, the piece movementrequest message representing a desired change in a position of a gamepiece image displayed on respective display areas of the first andsecond client computers. The processor circuit is also operablyconfigured to transmit a piece movement message representing the desiredchange in the position of the game piece image to each of the first andsecond client computers when the desired change meets a criterion.

The processor circuit may be operably configured to transmit a pointermessage to the first and second client computers in response to thepiece movement request message, the pointer message representing thechange in the position of the game piece image provided by the piecemovement request message.

The processor circuit may be operably configured to receive a piecerequest message including at least one of a user identifier associatedwith the client computer that transmitted the piece movement requestmessage to the server, an identifier identifying the game piece image,and an identifier identifying an owner of the game piece image, and theprocessor circuit is operably configured to transmit a piece movementmessage when at least one of the user identifier associated with theclient computer that transmitted the piece movement request message tothe server matches the identifier identifying the owner of the gamepiece, and the desired change in the position of the game piece imageidentified by the identifier identifying the game piece image complieswith a movement criteria associated with a game being played between thefirst and second client computers.

The processor circuit may be operably configured to transmit a piecemovement message including a message identifier, a user identifierassociated with the first client computer, and position coordinatesrepresenting a position of game piece image.

The processor circuit may be operably configured to transmit the piecemovement message by transmitting a copy of the piece movement requestmessage to the first client computer.

The apparatus may include a processor circuit operably configured toreceive a piece action request message at the server from one of thefirst and second client computers, the piece action request messagerepresenting a desired action to be performed on the game piece image,and transmit a piece action message representing the desired action toeach of the first and second client computers when the desired actionmeets a criterion.

In accordance with another aspect of the invention there is provided acomputer readable medium encoded with codes for directing a processorcircuit to support movement of game piece images displayed on first andsecond client computers in communication with a server in a computernetwork. The codes direct the processor circuit to receive a piecemovement request message at the server from one of the first and secondclient computers, the piece movement request message representing adesired change in a position of a game piece image displayed onrespective display areas of the first and second client computers. Thecodes also direct the processor circuit to and transmit a piece movementmessage representing the desired change in the position of the gamepiece image to each of the first and second client computers when thedesired change meets a criterion.

In accordance with another aspect of the invention there is provided acomputer readable signal encoded with codes for directing a processorcircuit to support movement of game piece images displayed on first andsecond client computers in communication with a server in a computernetwork. The codes direct the processor circuit to receive a piecemovement request message at the server from one of the first and secondclient computers, the piece movement request message representing adesired change in a position of a game piece image displayed onrespective display areas of the first and second client computers. Thecodes also direct the processor circuit to and transmit a piece movementmessage representing the desired change in the position of the gamepiece image to each of the first and second client computers when thedesired change meets a criterion.

In accordance with another aspect of the invention there is provided asystem for moving game piece images displayed on a first client computerin communication with a server in a computer network. The systemincludes a client processor circuit operably configured to cause atleast one game piece image to be displayed on a display area of thefirst client computer, the game piece image having an image area and animage boundary enclosing the image area. The client processor circuit isalso operably configured to receive a cursor movement signalrepresenting a cursor movement produced in response to user inputreceived from a pointing device in communication with the first clientcomputer, to determine whether a current position of the cursor iswithin the image boundary associated with the game piece image, and totransmit a piece movement request message to the server to elicit apiece movement message from the server when the current position of thecursor is within the image boundary. The piece movement request messagerepresents a desired change in a position of a cursor in response to thecursor movement signal. The system also includes a server processorcircuit operably configured to receive the piece movement requestmessage at the server from the first client computer, and to transmit apiece movement message representing the desired change in the positionof the game piece image to the first client computer when the desiredchange meets a criterion. The client processor circuit is operablyconfigured to receive the piece movement message, and cause a change ina position of the game piece image on the display area of the firstclient computer in response to the piece movement message.

Other aspects and features of the present invention will become apparentto those ordinarily skilled in the art upon review of the followingdescription of specific embodiments of the invention in conjunction withthe accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

In drawings, which illustrate embodiments of the invention;

FIG. 1 is a schematic view of a system for supporting multiple-partycommunications in accordance with a first embodiment of the invention;

FIG. 2 is a schematic view of a processor circuit for implementing aserver shown in FIG. 1;

FIG. 3 is a schematic view of a shared buffer implemented in the serverprocessor circuit shown in FIG. 2;

FIG. 4 is a screenshot of a web page displayed on a client computer inthe system shown in FIG. 1;

FIG. 5 is a flowchart representing blocks of codes for directing theserver processor circuit shown in FIG. 2 to execute a “create newcommunication process”;

FIG. 6 is a schematic representation of a communication table entry in acommunication table maintained by the sever processor circuit shown inFIG. 2;

FIG. 7 is a schematic representation of a client table entry in a clienttable maintained by the sever processor circuit shown in FIG. 2;

FIG. 8 is a flowchart representing blocks of codes for directing theserver processor circuit shown in FIG. 2 to execute a “list activemultiple-party communications” process;

FIG. 9 is a schematic view of a processor circuit for implementing theclient computer shown in FIG. 1;

FIG. 10 is a table listing selected mouse and keyboard eventsimplemented in a Java™ programming language;

FIG. 11 is a screenshot of a user interface displayed on the clientcomputers shown in FIG. 1;

FIG. 12 is a table of message formats used in the system shown in FIG.1;

FIG. 13A-13C are respective portions of a flowchart representing blocksof codes for directing the client computer processor circuit shown inFIG. 9 to produce messages for transmission to the server processorcircuit shown in FIG. 2;

FIG. 14 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 9 to transmit the messages to the serverprocessor circuit shown in FIG. 2;

FIG. 15A-15B are respective portions of a flowchart representing blocksof codes for directing the processor circuit shown in FIG. 2 to receivemessages from the client computer processor circuit shown in FIG. 9;

FIG. 16 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to process messages for transmissionto respective client computers;

FIG. 17 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to transmit messages to the clientcomputers;

FIG. 18A-18B are respective portions of a flowchart representing blocksof codes for directing the client computer processor circuit shown inFIG. 9 to receive messages from the server processor circuit shown inFIG. 2;

FIG. 19 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to transmit a published multiple-partycommunication page to the client computers;

FIG. 20 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 9 to transmit a game message to theserver;

FIG. 21 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 9 to display game piece images onrespective client computers;

FIG. 22 is a screenshot of an alternate embodiment of a user interfacedisplayed on the client computers shown in FIG. 1;

FIG. 23 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 9 to move game piece images onrespective display areas of the client computers shown in FIG. 1;

FIG. 24 is a game piece movement message format used in the system shownin FIG. 1;

FIG. 25 is a schematic view of a system for supporting multiple-partycommunications in accordance with a second embodiment of the invention;

FIG. 26 is a screenshot of a web page transmitted by a server shown inFIG. 25;

FIG. 27 is a screenshot of another web page transmitted by the servershown in FIG. 25;

FIG. 28 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to add a designated client computer toan active multiple-party communication;

FIG. 29 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to receive messages from the clientcomputers and the designated client computer shown in FIG. 25;

FIG. 30 is a screenshot of a web page listing saved multiple-partycommunications transmitted to the designated client computer by theserver shown in FIG. 25;

FIG. 31 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to respond to a request by adesignated client computer to view saved multiple-party communicationcontent;

FIG. 32 is a flowchart representing blocks of codes for directing theprocessor circuit shown in FIG. 2 to transmit output messages to clientcomputers and the designated client computer shown in FIG. 25;

FIG. 33 is a schematic view of a system for supporting multiple-partycommunications in accordance with a multiple-server embodiment of theinvention;

FIG. 34 is a flowchart representing blocks of codes for directing aprocessor circuit to create a new multiple-party communication in themultiple-server system shown in FIG. 33; and

FIG. 35 is a schematic view of a system for supporting multiple-partycommunications in accordance with another embodiment of the invention.

DETAILED DESCRIPTION

System Overview

Referring to FIG. 1, a system for supporting multiple-partycommunications in accordance with a first embodiment of the invention isshown generally at 10. The system 10 includes a server 12 and aplurality of client computers 14, 16, and 18. In this embodiment theclient computer 14 is a conventional desktop computer, the clientcomputer 16 is a laptop computer, and the client computer 18 is ahandheld computer. Each of the client computers 14, 16, and 18communicates with the server 12 through a network 20 such as theinternet or an intranet, for example.

Each of the client computers 14, 16, and 18 has a display 15, 17, and 19respectively for displaying text, characters, and/or graphics on adisplay area thereof. Each of the client computers 14, 16, and 18 alsohas a pointing device 22, 24, and 26 respectively. In this embodimentthe pointing device 22 is a conventional hand-held pointing device suchas a computer mouse, the pointing device 24 is a touchpad, and thepointing device 26 is a stylus for providing user input on a touchsensitive display 19.

The pointing devices 22, 24, and 26 generally produce user input signalsfor moving a cursor on the respective displays 15, 17, or 19, and mayadditionally provide actuator buttons for producing actuator buttonsignals for performing various other user input functions.

In addition, each of the client computers 14, 16, and 18 has a characterinput device shown generally at 28, 30, and 32 respectively forreceiving user input signals representing characters and for controllingcertain operations of the client computer. The character input devices28 and 30 are both conventional keyboard input devices. The characterinput device 32 may include areas on the touch sensitive display 19 thatare mapped to characters, or may alternatively include a handwritingrecognition engine for converting the user's handwriting motions of thepointing device 26 on the touch sensitive display 19 into characterrepresentations.

Thus, both the pointing devices 22, 24, and 26 and the character inputdevices 28, 30 and 32 are operable to produce user input signals thatfacilitate user input to the respective client computers 14, 16, and 18.Certain user input signals, whether received through the respectivepointing device 22, 24, or 26, or through the respective character inputdevice 28, 30, or 32, are formatted into messages by the clientcomputers 14, 16, or 18, and are transmitted through the network 20 tothe server 12.

In general the server 12 is configured to receive an input messagerepresenting user input received at one of the client computers 14, 16,or 18 and determine a message type associated with the input message.The server 12 then produces an output message representing the userinput provided by the input message. The output message is transmittedto each of the client computer 14, 16, and 18 when the input message isassociated with a persistent message type. When the input message isassociated with a non-persistent message type, the output message isonly transmitted to those of the client computers 14, 16, and 18 thatmeet a criterion.

Messages of the persistent type generally produce persistent changes tocontent on the display area, while messages of the non-persistent typedo not result in persistent changes to the display area.

Thus, for example, movements of the pointing device 22 are representedby non-persistent messages that are produced by the client computer 14and transmitted to the server 12. The server 12 then produces andtransmits an output message back to those of the client computers 14,16, and 18, to which all previously received messages of the persistentmessage type have already been transmitted.

A feature of the system 10 is that while user input, such as movementsof the pointing device 22 at the client computer 14, for example, arereflected almost immediately on the display 15 as a corresponding changein position of the cursor, the client computer also transmits a cursormessage to the server to elicit a pointer message from the server. Thecursor message represents a change in a position of the cursor inresponse to the user input received from the user of the clientcomputer. The client computer 14 receives the pointer message from theserver and causes a corresponding change in a position of a pointerassociated with the cursor and displayed on the display 15 in responseto the message, which represents the change in position of the cursor.

It will be appreciated that there is a latency that occurs due to theround-trip time required for a cursor message transmitted by one of theclient computers 14, 16, or 18 to reach the server 12, to beretransmitted by the server, and to be received back from the server atthe client computers. Accordingly, the user producing the pointingdevice movement will see a time lag between the position of their cursoron their display and the position of the pointer associated with thepointer message received back from the server 12.

Similarly, each of the client computers 16, and 18 also receive thepointer message representing the change in position of the cursor of theclient computer 14, and cause a corresponding change in a position of apointer associated with the client computer 14, which is displayed onthe respective display areas 17 and 18 of the client computers inresponse to the pointer message.

Advantageously, users are able to view their own real time cursor andtheir own and other user's pointers on their respective displays. Eachuser is thus made aware of other user's actions, thus providing afeeling of a real multiple-party presence in the multiple-partycommunication. Furthermore, the system 10 facilitates simultaneous userinput from all client computers, which is in contrast to some prior artsystems that only permit user input from a single designated presenter.

In this application the word “cursor” is used to refer to the clientcomputer cursor on the respective displays 15, 17, and 19. The word“pointer” is used to refer to a secondary pointer, which is alsodisplayed on the respective displays 15, 17, and 19 of the respectiveclient computers 14, 16, or 18.

In one embodiment the system 10 further facilitates public access topublished content created during a multiple-party communication and thesystem 10 may further include a public access computer 40 incommunication with the server 12 through the network 20. Publication ofmultiple-party communication content is described later herein.

Processor Circuit—Server

Referring to FIG. 2, a processor circuit for implementing the server 12is shown generally at 50. In this embodiment, the server processorcircuit 50 includes a microprocessor 52, a program memory 54, a randomaccess memory (RAM) 56, a persistent memory such as a hard drive 58, amedia reader 59, and an input output port (I/O) 60, all of which are incommunication with the microprocessor.

The I/O port 60 includes a network interface 62, such as a networkinterface card having an input/output 64 for connection to the network20, and through which communications are conducted with the clientcomputers 14, 16, and 18, as shown in FIG. 1.

Program codes for directing the microprocessor 52 to effect serverfunctions of the system 10 are stored in the program memory 54, whichmay be implemented as a random access memory (RAM), and/or a hard diskdrive (HDD), or a combination thereof.

The program memory 54 includes a block of codes 70 for directing theprocessor circuit 50 to effect communication manager functions, a blockof codes 72 for directing the processor circuit to effect client managerfunctions, a block of codes 74 for directing the processor circuit toeffect page management functions, a block of codes 75 for directing theprocessor circuit to effect web server functions, and a block of codes78 for directing the processor circuit to effect game criteriafunctions. The program memory 54 may also optionally include a block ofcodes 76 for directing the processor circuit 50 to effect media relayfunctions, as will be described later herein.

The hard drive 58 includes a plurality of stores including a clientsaved content store 100 for storing content displayed during an ongoingcommunication. The hard drive 58 also includes a user interface store101 for storing program codes operable to cause a user interface to bedisplayed on the client computers 14, 16, and 18, when downloaded by theclient computers.

The hard drive 58 further includes a web page store 102 for storing datarepresenting one or more web pages to be displayed on the clientcomputers 14, 16, or 18 during the multiple-party communication. Thedata stored in the web page store 102 may include Hypertext MarkupLanguage (HTML) data, for example.

The hard drive 58 further includes a communication page store 104 forsaving pages of content created during multiple-party communications, anupload data store 106 for storing image data and/or other data uploadedby the client computers 14, 16, and 18 to the server 12, a publishedcommunication store 108 for storing published multiple-partycommunication content, and a game data store 109 for storing dataassociated with a game being played between client computers during thecommunication.

In other embodiments the hard drive 58 may be substituted by anotherform of persistent memory, such as a flash memory, for example.

The media reader 59 facilitates loading program codes into the programmemory 54 from a computer readable medium 110 such as a CD ROM disk 112.Alternatively the program codes may be provided by a computer readablesignal 114, which may be received over a network such as the internet,for example.

The RAM 56 includes a plurality of storage blocks including acommunication table storage block 80 for storing a communication tableholding information associated with active multiple-party communicationsbeing hosted by the server 12.

The RAM 56 also includes a storage block for each active multiple-partycommunication in the communication table 80. In this embodiment theprocessor circuit 50 is hosting three active multiple-partycommunications and accordingly three such storage blocks 82, 84, and 86are shown.

Each storage block 82, 84, and 86 includes a shared memory buffer 88 forstoring messages received from each of the client computers 14, 16 and18. Each storage block 82, 84, and 86 further includes a client tablestorage block 90 for storing a client table holding identifications ofrespective client computers participating in each correspondingmultiple-party communication.

Each storage block 82, 84, and 86 also includes a plurality of serverside receive (Rx) buffers 92 and a plurality of server side transmit(Tx) buffers 94, including one Rx buffer and one Tx buffer for eachclient included in the client table 90.

In general, each storage block and/or buffer in the RAM 56 may include aplurality of storage locations implemented in random access memory, forexample.

Shared Memory Buffer

The shared memory buffer 88 is shown in greater detail in FIG. 3.Referring to FIG. 3, the shared buffer 88 includes a plurality ofmessage stores 120 each being of sufficient size to hold one message,which in this embodiment are 30 bytes long. Each message store 120(which are labeled as 1, 2, . . . n in FIG. 3) has an associated memoryaddress. A “StartPointer” 122 is used to point to one of the messagestores 120 to which a first message was written. A “CurrentPointer” 124is used to point to one of the message stores 120 to which a lastmessage was written. A plurality of client “SentPointer”s 126 are usedto point to one of the message stores 120, whose contents were lasttransmitted to the respective client computer. Each of the clientcomputers 14, 16, or 18 thus has a corresponding “SentPointer” 126.

In general, the data pointers 122 and 124 are variables stored in thecommunication table 80 and having respective values that reference (or“point” to) a memory address of one of the message stores 120. Similarlythe client “SentPointer”s 126 are variables stored in an associatedclient table 90, having respective values that reference a memoryaddress of one of the message stores 120.

In some embodiments the shared buffer 88 may be implemented as acircular buffer, in which case after a message has been written to the“n^(th)” message store 120, the “CurrentPointer” 124 wraps around and isreset to point to the “1^(st)” data store, and newly received messageswill overwrite older messages in the shared buffer.

Each multiple party communication hosted by the server 12 has a singleassociated shared buffer 88. The shared buffer 88 is generally operableto store messages received from the client computers 14, 16, and 18 thathave joined a multiple party communication. The shared buffer 88 furtheracts as a memory buffer for storing output messages to be transmitted tothe client computers 14, 16, and 18. Advantageously, in this embodiment,output messages are produced by copying the input messages into theshared buffer 88, and accordingly only a single shared buffer 88 is usedfor each communication. In other embodiments output messages may havedifferent formats and/or payload data to the input messages and in suchembodiments an input shared buffer may be used to hold input messages,and output messages may be produced by reading the payload of the inputmessages and generating a corresponding output message, which may bestored in an output shared buffer.

Web Page

Referring to FIG. 4, a screenshot of a web page displayed on the clientcomputers 14, 16, or 18 when the client computers first connect to theserver 12 is shown generally at 130. In general the client computers 14,16, or 18 connect to the server 12 by directing a hypertext transferprotocol (HTTP) request for the web page 130 to the network interface 62of the server processor circuit 50. The HTTP request from the clientcomputer 14, 16, or 18 may be generated by a web browser applicationrunning on the client computer, for example.

When the HTTP request for the web page 130 is received at the networkinterface 62, the web server program codes 75 direct the servermicroprocessor 52 to read data representing the web page 130 from thestore 102 on the hard drive 58, and to transmit the data through thenetwork 20 to the client computer. The data representing the web page130 may be communicated in one or more HTTP messages transmitted using anetwork transport protocol such as transmission control protocol overinternet protocol (TCP/IP), for example.

When the HTTP data is received by the client computer 14, 16, or 18, theweb browser application causes the web page 130 to be displayed in abrowser window on a respective display 15, 17, or 19 of the clientcomputers.

The web page 130 includes a “create new communication” button 132 and a“CommunicationName” field 134 for the user to enter a communicationname. The web page 130 further includes a “CommunicationPassword” field136 for optionally assigning a password when creating a newcommunication, such that access to the communication may be limited tousers who are in possession of the password. The web page 130 furtherincludes a “list active communications” button 138.

When a user of one of the client computers 14, 16, or 18 (an originatingclient) enters a communication name in the “CommunicationName” field 134and clicks on the “create new communication” button 132, the clientcomputer transmits a signal to the network interface 62 of the serverprocessor circuit 50 to request creation a new communication. Forexample, the transmitted signal may include an HTTP request messageincluding the communication name and password (if provided).

Create New Communication Process

Referring to FIG. 5, a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to create a new multiple-partycommunication is shown generally at 150. The blocks generally representcodes read from the program memory 54, for directing the microprocessor52 to perform various communication manager, client manager, and pagemanager functions related to creating a new communication. The actualcode to implement each block may be written in any suitable programminglanguage, such as Flash™, Java, Delphi®, C, and/or C++, for example.

In general, the communication manager program codes 70 direct themicroprocessor 52 to provide communication manager functions forcreating the new multiple-party communication, and further direct themicroprocessor 52 to cause the page manager program codes 74 and theclient manager program codes to be launched in the process of creatingthe new communication.

The process 150 begins at 152 when a signal, such as an HTTP requestmessage, is received from one of the client computers 14, 16, or 18 atthe network interface 62, requesting that a new multiple-partycommunication be created.

Block 154 then directs the microprocessor 52 to read the communicationname provided and the password (if provided) in the HTTP request messagereceived from the client computer. Block 154 further directs themicroprocessor 52 to add a new communication entry to the communicationtable 80 in the RAM 56.

Communication Table Entry

The communication table entry is shown in greater detail in FIG. 6 at180. Referring to FIG. 6, the communication table entry 180 includes aplurality of fields identifying the communication, which are populatedwhen block 154 (shown in FIG. 5) directs the microprocessor 52 to addthe new communication entry to the communication table 80 stored in theRAM 56.

The communication table entry 180 includes a communication identifier(“CID”) field 182, which is populated with a unique communicationidentifier number assigned to the new multiple-party communication.

The communication table entry 180 also includes a “CommunicationName”field 184, which is populated with the communication name assigned bythe originating client in the “CommunicationName” field 134 on the webpage 130 (shown in FIG. 4). The entry 180 also includes a“CommunicationPassword” field 186, which is optionally assigned by theoriginating client in the “CommunicationPassword” field 136 on the webpage 130. If no communication password is assigned by the originatingclient, the “CommunicationPassword” field 186 on the communication tableentry 180 is left empty.

The communication table entry 180 further includes a“KeepRunningIdleFlag” field 188 for storing a flag indicating whetherthe communication should be kept running after the last client hasdisconnected from the server 12.

The communication table entry 180 also includes a “StartPointer” field190 and a “CurrentPointer” field 192, for storing address values of the“StartPointer” 122 and the “CurrentPointer” 124 respectively, as shownin FIG. 3.

The communication table entry 180 further includes a list of pages field194 for storing a listing of the pages created during the communication.The entry 180 also includes a current page field 196 for storing a valueidentifying a currently loaded page in the communication.

The communication table entry 180 may also have an associated“HiddenFlag” field 198 for storing a flag value indicating whether thecommunication should be hidden. As described later herein, certainmultiple-party communications may be created to allow the public accesscomputer 40 (shown in FIG. 1) to access published communication contentor to permit lawful intercept authorities to intercept communicationcontent. Advantageously, the client computers 14, 16 and 18 are not madeaware of the existence of communications for which the hidden flag isset to active.

Referring back to FIG. 5 the process continues at block 156, whichdirects the microprocessor 52 to create a new shared buffer 88 andassociated the shared buffer with the CID of the multiple-partycommunication. Block 156 further directs the microprocessor 52 toinitialize the “StartPointer” 122 and the “CurrentPointer” to refer to afirst store 120 in the shared buffer 88 and to instantiate a pagemanager for the multiple-party communication by initiating execution ofthe page manager program codes 74.

Block 158 then directs the microprocessor 52 to instantiate a new clientmanager for the multiple-party communication by launching the clientmanager program codes in the store 72.

In this embodiment the communication manager instantiates a separateclient manager for each communication included in the communicationtable 80. The communication manager continues running in parallel withthe page manager and the client manager, such that the processor circuit50 is able continue to provide communication manager functions and/orcreate other new multiple-party communications.

The remaining blocks of the process 150 directs the microprocessor 52 toperform various client manager functions associated with the newlycreated multiple-party communication. The process continues at block160, which directs the microprocessor 52 to generate a new client table90 in the RAM 56, and to add an identification entry to the client tableidentifying the originating client computer.

Client Table Entry

The client table entry is shown in greater detail in FIG. 7 at 200.Referring to FIG. 7, the client table entry includes a plurality offields identifying the associated client computer, which are populatedwhen block 160 (shown in FIG. 5) directs the microprocessor 52 to addthe originating client entry to the client table 90 stored in the RAM56.

The client table entry 200 includes a client computer identifier field(“UID”) 202, which is populated with a unique client computer identifiernumber (“UID”) assigned to the client computer.

The client table entry 200 further includes a client IP address field204, and a client port field 206, which are populated with valuesobtained from the header of an internet protocol data packet receivedfrom the client computer at the server network interface 62.

The client table entry 200 further includes a “CatchUpFlag” field 208,which when set, indicates that the client computer needs to “catch up”with previous data shared during the multiple-party communication. Whenan originating client computer creates a new multiple-partycommunication, the “CatchUpFlag” 208 in the client table entry 200 forthe client computer is set to not active, as described later herein.

The client table entry 200 also includes a “SentPointer” 210, whichholds an address of one of the message stores 120 in the shared buffer88, corresponding to a message that was last transmitted to thecorresponding client computer. The client “SentPointer” field 210 isinitially set to “nil” and is subsequently set equal to the“StartPointer” 122 once a first message is transmitted to the clientcomputer by the server 12.

Finally the client table entry 200 may also have an associated“SilentFlag” 212 for holding a flag value, which when set to active,indicates that the user of the client computer corresponding to theclient “UID” is an intercept authority. Designated intercept clientcomputers are treated differently by the server than the clientcomputers 14, 16 and 18, as described later herein.

Referring back to FIG. 5 the process 150 continues at block 162, whichdirects the microprocessor 52 to create a server side Rx buffer 92 and aserver side Tx buffer 94 in the RAM 56 for the originating client. Theserver side Rx buffer 92 is used to temporarily store messages receivedfrom the client computer and the server side Tx buffer 94 is used totemporarily store messages to be transmitted to the client computer.Creating the server side Rx buffer 92 and the server side Tx buffer 94may involve opening a network socket for communications between each oneof the client computers 14, 16, and 18 and the server, for example. Anetwork socket is a software function provided by most operating systemsthat facilitates communications over a computer network. Network socketfunctions generally allocate Rx and Tx buffers which may be used as theRx and Tx buffers 92 and 94.

Block 164 then directs the microprocessor 52 to read the user interfacecodes from the user interface store 101 of the server hard drive 58 andto cause the network interface 62 of the I/O PORT 60 to transmit theuser interface codes through the network 20 to client computer thatoriginated the communication.

Join Active Communication Process

Referring back to FIG. 4, when a user of one of the client computers 14,16, or 18 clicks on the “list active communications” button 138 an HTTPrequest message is transmitted to the network interface 62 of the serverprocessor circuit 50 requesting a listing of active multiple-partycommunications currently being hosted by the server 12.

Referring to FIG. 8, a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to transmit a listing of activemultiple-party communications to the client computer is shown generallyat 230. The process begins at 232 when the HTTP message requesting anidentification of active multiple-party communications is received atthe network interface 62.

Block 234 directs the microprocessor 52 to read the communication tableentries 180 and the corresponding client table entries 200 (shown inFIGS. 6 and 7 respectively) in the communication table 80 andcorresponding client table 90 stored in the RAM 56. Block 235 thendirects the microprocessor 52 to transmit data to client computeridentifying active communications being hosted by the server. Theprocess 230 then ends at 236.

Referring back to FIG. 4, the client computer receives the data from theserver 12 and displays a table identifying active multiple-partycommunications shown generally at 140.

The table 140 includes a first column 142 listing a sequence numberassigned to the multiple-party communication (i.e. 1, 2, 3 . . . forexample). The table 140 also includes a second column 144 listing thecommunication name from the “CommunicationName” field 184, and a thirdcolumn 146 listing a communication type. The communication type is setto “free” when no password has been assigned by the originating user forthe multiple-party communication, and to “password” when a password isrequired to join the multiple-party communication. The table 140 alsoincludes a fourth column 148, listing a number of client computer usersinvolved in each respective multiple-party communication.

In this embodiment, the table 140 is only displayed after the useractivates the “list active communications” button 138, but in otherembodiments the “list active communications” button 138 may be omittedand the table 140 may be displayed when the web page 130 is loaded fromthe server 12 by the client computer 14, 16, or 18.

In general, fields in at least one of the columns in the table 140 haveassociated hyperlink properties, which facilitate selection of aparticular multiple-party communication by clicking on a hyperlinkassociated with the multiple-party communication. For example, in theembodiment shown in FIG. 4, the communication names listed in bold fontin column 144 may include such hyperlink properties.

When the user of one of the client computers 14, 16, or 18 clicks on oneof the hyperlinked communication names in column 144, the web browserapplication program codes 281 (shown in FIG. 9) direct themicroprocessor 262 to transmit an HTTP message to the server 12. TheHTTP message includes an identifier identifying the multiple-partycommunication, such as the communication name and/or the communicationidentifier “CID” for the multiple-party communication.

Still referring to FIG. 8, a flowchart of blocks of code for directingthe processor circuit 50 to add the client computer to an activecommunication is shown generally at 237. The process begins at 238 whenthe server processor circuit 50 receives an HTTP request messageidentifying an active communication that the user of the client computerwishes to join.

Block 239 directs the microprocessor 52 to read the information in theHTTP message received from the client computer and to match theinformation to a multiple-party communication in the communication table80. For example, if the HTTP message includes a communicationidentifier, the “CID” is read from the HTTP message and compared withthe values in the “CID” field 182 in the communication table entries 180find the corresponding multiple-party communication. Alternatively, ifthe HTTP message includes a communication name, the communication nameis compared with the values in the “CommunicationName” field 184 in thecommunication table entry 180 to find the corresponding multiple-partycommunication.

Block 239 also directs the microprocessor 52 to instantiate a clientmanager for the client computer. In general, a separate thread of theclient manager is instantiated and associated with each client computerin the communication and each client manager thread is associated withthe communication.

Referring back to FIG. 8, the remaining blocks 240 to 244 in the process230 direct the server processor circuit 50 to perform client managerfunctions.

Block 240 then directs the microprocessor 52 to add a new client tableentry 200 identifying the client computer to the corresponding clienttable 90 for the selected multiple-party communication. Block 240 alsodirects the microprocessor 52 to populate the fields in the new clienttable entry, and to set the “CatchUpFlag” 208 in the client table entry200 to active and to set the client “SentPointer” field 210 to “nil”.

When a client computer user joins an already active multiple-partycommunication, the “CatchUpFlag” 208 is set to active to cause messagesin the multiple-party communication that the client computer user mayhave missed by joining the multiple-party communication late to betransmitted to the client computer. The client “SentPointer” field 210is set equal to the “StartPointer” 122 once the first message istransmitted to the client computer.

Block 242 then directs the microprocessor 52 create server side Rx andTx buffers 92 and 94 for the client. Advantageously each client computer14, 16, and 18 has corresponding server side Rx and Tx buffers, whichfacilitate transmitting multiple-party communication data that mayalready have been transmitted to other client computers to clientcomputer users who join a multiple-party communication after themultiple-party communication has started (i.e. all clients other thanthe originating client for the multiple-party communication).

Block 244 then directs the microprocessor 52 to read the user interfacecodes from the user interface store 101 and to cause the networkinterface 62 of the I/O PORT 60 to transmit the user interface codesthrough the network 20 to the client computer.

Processor Circuit—Client Computer

Referring to FIG. 9, a processor circuit of the client computers 14, 16,and/or 18 is shown generally at 260. In this embodiment, the clientprocessor circuit 260 includes a microprocessor 262, a program memory264, a random access memory (RAM) 266, a media reader 268, and aninput/output port (I/O) 270, all of which are in communication with themicroprocessor 262.

The I/O port 270 includes an interface 272, such as a network interfacecard having an input/output 274 in communication with the network 20.The interface 272 facilitates transmitting messages to the server 12 andreceiving messages from the server, as shown in FIG. 1. Alternativelythe interface 272 may include a wireless interface for connecting to awireless network access point 276, which facilitates connection to thenetwork 20.

The I/O port 270 further includes an input 278 for receiving user inputsignals from a character input device (such as the character inputdevice 28 shown in FIG. 1), and from a pointing device (such as thepointing device 22 shown in FIG. 1).

The I/O port 270 further includes an output 279 for producing displaysignals for causing a client computer display (such as the display 15shown in FIG. 1) to display images, characters, and cursors, forexample.

Program codes for directing the microprocessor 262 to effect clientfunctions of the system 10, shown in FIG. 1, are stored in the programmemory 264, which may be implemented as a random access memory (RAM),and/or a hard disk drive (HDD), or a combination thereof. The programmemory 264 includes a block of codes 280 for directing the processorcircuit to effect operating system (O/S) functions, and a block of codes281 for directing the processor circuit to provide web browsingfunctions.

The program memory 264 also includes a block of codes 282 for directingthe processor circuit 260 to effect various user interface functions.The block of codes 282 includes a first block of codes 284 for directingthe processor circuit 260 to effect a message receiver function, asecond block of codes 286 for directing the processor circuit to effecta message sender function, a third block of codes 288 for directing theprocessor circuit to effect interrupt handler functions, and a fourthblock of codes 289 for directing the processor circuit 260 to effectdisplay functions.

In one embodiment the user interface program codes 282 are received atthe interface 272 in one or more HTTP messages from the server 12. Theprogram codes are then extracted from the HTTP message payload andloaded into the program memory 264.

Alternatively, the media reader 268 may be used to load user interfaceprogram codes from a computer readable medium 300 into the programmemory 264. The computer readable medium 300 may be a CD ROM disk 302.Alternatively the program codes may be provided by a computer readablesignal 304, which may be received over a network such as the internet,for example.

The RAM 266 includes a plurality of storage blocks including a clientside receive (Rx) buffer 290 for temporarily storing messages receivedfrom the server 12 and a client side transmit (Tx) buffer 292 fortemporarily storing messages to be transmitted back to the server 12. Ingeneral, the buffers 290 and 292 include a plurality of storagelocations in the RAM 266 and may be implemented by opening a networksocket using operating system functions provided by the operating system280.

The RAM 266 also includes a character entry position store 294 forstoring coordinates of a character entry position, a pointer table store295 for storing a table of pointers, and a hyperlink and filename/URLstore 296 for storing coordinates and filenames or internet addressesassociated with one or more hyperlinks.

The RAM 266 further includes a game piece image store 298 for storinginformation associated with a game that may be played during themultiple-party communication. The RAM 266 also includes a game piececoordinate 299 store for storing variables representing coordinates ofthe game piece images.

The processor circuit 260 may optionally include a persistent data store310 (such as a hard drive) for persistent storage of data. Thepersistent data store 310 may be used for persistent storage of programcodes, and image files, for example. The persistent data store 310 mayalso be used for storage of data related to multiple-partycommunications. However in the embodiments described hereinmultiple-party communication data is stored on the server hard drive 58and the system 10 does not directly make use of persistent data store310 on the client computer processor circuit 260.

Producing Messages—Client Computer

In general, client computers 14, 16, and/or 18 in a multiple-partycommunication produce messages in response to user input signals and/orcombinations of user input signals and function invocations. The userinput signals may include character signals representing character inputreceived from the character input device 28, cursor movement signalsrepresenting a cursor movement produced in response to user inputreceived at a pointing device 22, and actuator button signals producedin response to user actuation of actuator buttons associated with thepointing device. The messages generated by the client computers 14, 16and 18 are transmitted to the server 12.

Still referring to FIG. 9, the operating system program codes 280 in theprogram memory 264 direct the microprocessor 262 to cause the I/O port270 to monitor signals received at the input 278 from the characterinput device 28 and the pointing device 22, and to generate interruptevent signals in response to the user input signals. The interrupt eventsignals produced by the operating system are read by the user interfaceinterrupt handler 288. For example, in the Microsoft Windows® operatingsystem, interrupt event signals are written to a message queue and theinterrupt handler 288 is registered to receive or listen to certainevent signals in the message queue.

For example, mouse input signals are produced when a button on thepointing device 22 is actuated and released, the mouse is moved (i.e. nobuttons actuated), or the mouse is dragged (i.e. moved while pressing amouse button). The operating system receives these signals and producesinterrupt event messages including coordinate positions and otherinformation identifying the input, which are written into the messagequeue. Similarly, keyboard input signals produce interrupt eventmessages which are also written into the message queue.

The interrupt handler program codes 288 further direct themicroprocessor 262 to provide functions for reading the message queueand for handling the operating system interrupt event messages. Forexample, in Java programming language, getX and getY functions areprovided for returning the X and Y coordinates of a cursor, which hasbeen moved in response to user input from the pointing device. The event“KeyTyped”(KeyEvent e) is invoked following a keyboard interrupt, wherethe actuated key is represented by a numeric value in a “KeyEvent”object produced by the Java function.

Referring to FIG. 10, a table listing selected methods for acting onmouse and keyboard interrupts in the Java programming language is showngenerally at 320. The methods listed include a mouseClicked(MouseEvente) 322, which is invoked when the mouse button has been actuated, amouseDragged(MouseEvent e) 324, which is invoked when a mouse button hasbeen actuated on the mouse and then the mouse has been dragged, amouseMoved(MouseEvent e) 326, which is invoked when the mouse cursor hasbeen moved but no buttons have been actuated, and a keyTyped(KeyEvent e)328, which is invoked when a key has been typed.

In some instances two or more of the event signals may be generatedessentially simultaneously in response to the user input. For examplewhen the user of the client computer 14, 16 or 18 actuates the mousebutton, then drags the mouse while the button is actuated, and thenreleases the mouse button several event signals are produced. When themouse button is actuated, none of the events listed in FIG. 10 areproduced until the user drags the mouse (a “mousePressed” event isproduced, but this event is not used in this embodiment). Generally themouse drag will produce a plurality of “mouseDragged” event signalswhile the mouse is being dragged and each individual “mouseDragged”signal or message defines a portion of the movement of the mouse. At theend of the mouse drag, the user releases the mouse button, which causesthe “mouseClicked” event signal to be produced (since the button wasactuated and then subsequently released). The mouse drag may thus bedefined by a plurality of event signals between a location at which themouse button was actuated and a location at which the mouse button wasreleased.

Other programming languages such as Adobe Flash, C⁺⁺, and Delphi provideequivalent functionality for handling such events.

User Interface

When a user of one of the client computers 14, 16, or 18 joins amultiple-party communication, either by clicking the “create newcommunication” button 132 on the web page 130 shown in FIG. 4, or byclicking the “list active communications” button 138 and selecting amultiple-party communication to join from the table 140, the server 12transmits program codes to the client computer for displaying the userinterface 470 (shown in FIG. 11) on the client computer display 15. Asdescribed above, the user interface program codes may include Java orFlash program codes for directing the microprocessor 262 to provide userinterface functions. The program codes may be downloaded from the server12 and automatically executed after downloading.

Alternatively, the client computer may launch program codes (not shown)for instantiating a stand-alone user interface program, which causes theuser interface 470 to be displayed without being downloaded from theserver 12.

Referring to FIG. 11, the user interface 470 includes a control panel471, a display area 472 for displaying multiple-party communicationcontent, and a status bar 490. The control panel 471 includes an“ImageShow” function invocation button 474 for transmitting a message tothe server to cause an image 475 to be displayed on the display area472, a “ClearScreen” function invocation button 476 for transmitting amessage to the server to cause the display area to be cleared, a “Save”function invocation button 477 for transmitting a message to cause theserver to save presently displayed content, and an “Open” functioninvocation button 494 for transmitting a message to cause the server toload and transmit messages representing previously saved content. Thecontrol panel 471 also includes a “PageBack” function invocation button478 and “PageForward” function invocation button 480 for transmitting amessage to the server for causing messages associated with previousdisplayed pages to be transmitted to the client computers, a“LinkCreate” function invocation button 495 for transmitting a messageto the server identifying a link to a web page or previously savedcontent on the server, and a “Publish” function invocation button 493for transmitting a message to the server to cause content to bepublished. The control panel 471 also includes a “Clipboard” functioninvocation button 488 for uploading clipboard data to the server and fortransmitting a message to the server identifying the upload data, and a“Quit” function invocation button 482 for transmitting a message to theserver to cause the client computer to be disconnected when the user ofthe client computer wishes to leave the multiple-party communication.The control panel 471 further includes a “Game” function invocationbutton 491 for transmitting as message to the server to cause game pieceimages to be displayed on the display area 472, as described laterherein.

The control panel 471 further includes line formatting controls 484 forselecting a color and width of a line to be drawn on the display area472, and character formatting controls 486 for selecting a font, color,and size of characters to be displayed on the display area.

In general user interface 470 causes content such as an image 475, asingle client computer cursor 496, and a client computer pointer 499 foreach client computer in the multiple-party communication, to bedisplayed in response to messages received from the server 12. In otherembodiments, each client computer may display only its own cursor 496and other client computer pointers 499, in which case the clientcomputer user will not be able to view their own pointer on the displayarea. When the user interface 470 is displayed on the handheld clientcomputer 18 (shown in FIG. 1) an actual cursor may not be displayed onthe display 19 since the tip of the stylus 26 provides a visualindication of the cursor position. In such systems, the stylus 26 actsas the cursor, and although no actual cursor is displayed on the screen,the operating system of such devices receives user input signals inresponse to movement of the stylus tip in contact with the touch screendisplay area and produces corresponding interrupt event signals asdescribed above.

The status bar 490 generally display status information associated withthe multiple-party communication. In this embodiment the status bar 490includes a field 492 for displaying the number of client computers thathave joined the multiple-party communication, and may include otherinformation such as the duration of the multiple-party communication,communication name etc.

The display area 472 may also have a linked area 497, which links to afile or web page when clicked by the user. In the embodiment shown thelink 497 includes an identifier (not shown) identifying a filename of afile on the server hard drive 58 including image data for the Ethnavolcano image 475. In other embodiments the link identifier may includea uniform resource locator (URL) identifying image data or an image fileelsewhere on the network 20. When the client cursor 496 is moved withinthe linked area 497, the user interface image display program codes 289direct the microprocessor 262 to cause the client cursor 496 to changefrom displaying an arrow to display a hand-shaped cursor 498 (inpractice, either the arrow cursor 496 or the hand cursor 498 is visible,not both as shown in FIG. 11 for illustrative purposes only).

In general, the display area 472 may include a plurality of linked areassuch as the linked area 497, each linked area having an associatedidentifier. The coordinates of each linked area 497 and the associatedidentifier are stored in the store 296 in the RAM 266. In the embodimentshown the linked area 497 comprises a rectangular area of the displayarea 472 and may be defined by a first pair of X and Y coordinatesdefining a top left hand corner of the linked area and a second pair ofX and Y coordinates defining a bottom right hand corner of the linkedarea. Alternatively, the linked area 472 may have other geometric shapeshaving a position and/or shape defined by one or more coordinate pairs.

Message Format

Referring to FIG. 12, a table of messages used in the communicationsystem 10 is shown generally at 330. In general, three message types areprovided including:

-   -   Persistent messages 332 that produce persistent changes to        content on the display area 472;    -   Non-persistent messages 334 that do not result in persistent        changes to the display area, for example, messages that cause        pointers to change position within the display area 472, but do        not leave persistent changes on the display area; and    -   Control messages 336 that cause a server action to be performed        for managing server and/or client activity that also do not        cause persistent changes to the content in the display area 472        (except for messages that cause page changes or clearing of the        screen).

Each message 330 comprises 30 bytes of information, with the 30^(th)byte being the null character, indicating the end of the message. Anyunused bytes in the message are padded with zeroes.

Each message 330 includes a message identifier (MsgID) in bytes 1 and 2.In this embodiment message identifiers in the range 1-9 are associatedwith persistent messages 332, message identifiers in the range 10-19 areassociated with non-persistent messages 334, and message identifiers 20are associated with control messages 336. Accordingly, in thisembodiment the message identifier also functions as a message typeindicator, since the message type may be derived from the messageidentifier. In other embodiments, the messages 330 may include aseparate message type indicator (not shown) indicating a message typeassociated with each message.

Each message 330 also includes the user identifier (UID) 202 (shown inFIG. 7) in bytes 3 and 4. In other embodiments the messages 330 may beof different byte size, may have variable byte lengths, and/or maycomprise an Extensible Markup Language (XML) message format, forexample.

Each message 330 represents a particular type of user input and mayinclude addition information, such as coordinate positions, in a messagepayload. The message identifier field indicates the specific type ofuser input included in the message payload

The persistent messages 332 are generated in response to user input thatcauses persistent lines to be drawn, characters to be displayed, and/orimages to be displayed on the user interface 470.

The persistent messages 332 include a “KeyTyped” message 338 having amessage identifier of 1, which represents a user input key (orcharacter). The specific key typed is represented by a numeric valueheld in bytes 11 and 12. The “KeyTyped” message 338 also includes X andY coordinates (Xnew, Ynew) held in bytes 13-16 of the message, colordisplay information associated with the character held in the bytes 5-7,a font identifier, style identifier, and a size identifier held in bytes8-10.

The persistent messages 332 also include a “MouseDrag” message 340having a message identifier of 2, which represents a line drawn on thedisplay area 472 of the user interface 470. The “MouseDrag” message 340includes starting X and Y coordinates (Xold, Yold) and ending X and Ycoordinates (Xnew, Ynew) held in bytes 9-16 of the message. Colorinformation associated with the line is held in the bytes 5-7, and awidth of the line is held in byte 8.

The persistent messages 332 also include an “ImageShow” message 342having a message identifier of 3, which represents an image location(such as the image 475 shown in FIG. 11) posted by the user on theclient computer display area 472 of the user interface 470. The“ImageShow” message 342 also includes X and Y coordinates (Xnew, Ynew)held in bytes 5-8 and an image filename held in bytes 9-29.

The persistent messages 332 also include a “LinkCreate” message 344having a message identifier of 4, which represents a link created by theuser on the client computer display area 472 of the user interface 470(such as the linked area 497 shown in FIG. 11). The “LinkCreate” message344 also includes X and Y coordinates (X1, Y1) and (X2, Y2) held inbytes 5-12 and a filename or internet address held in bytes 13-29.

The persistent messages 332 also include a “Game” message 359 having amessage identifier of 5, which represents a request by a user of theclient computer to display game piece images on the display area 472 ofthe user interface 470.

In this embodiment the non-persistent messages 334 include only a“MouseMove” message 346 having a message identifier of 10, whichrepresents a mouse movement made by the user that causes the cursor tomove without drawing a line on the display area 472. The “MouseMove”message 346 includes ending X and Y coordinates (Xnew, Ynew) held inbytes 5-8. Other embodiments may include further non-persistentmessages.

The “MouseMove” message 346 and the “MouseDrag” message 340 represent achange in position of a cursor associated with the display area 472 ofthe client computer, and when transmitted to the server 12 thesemessages may be referred to as cursor messages.

The control messages generally cause functions to be performed by theserver 12, but generally do not produce new content on the display area472. The control messages 336 include a “ClearScreen” message 348 havinga message identifier of 20, which represents a command to clear a pagedisplayed on the display area 472.

The control messages 336 also include a “Save” message 350 having amessage identifier of 21, which represents a request by a clientcomputer user to save content currently displayed on the display area472 to the client saved content store 100 in the server hard drive 58(shown in FIG. 2). The “Save” message 350 includes a filename, which isheld in bytes 5-29 of the message.

The control messages 336 also include an “Open” message 352 having amessage identifier of 22, which represents a request by a user to loadcontent saved in the client saved content store 100 in the server harddrive 58. The “Open” message 352 includes a filename, which is held inbytes 5-29 of the message.

The control messages 336 also include a “PageChange” message 354 havinga message identifier of 23, which represents a request by a user tochange the current displayed page to a page stored in the communicationpage store 104. In general the communication page store 104 may storeseveral pages of content and accordingly the “PageChange” message 354includes a “PageFlag” value held in byte 5 of the message forinstructing the server 12 to display a previous page (when the“PageFlag” value is “0”), or to display the next page (when the“PageFlag” is “1”).

The control messages 336 also include a “Disconnect” message 356 havinga message identifier of 24, which represents a request of the user todisconnect from the multiple-party communication, while themultiple-party communication continues.

The control messages 336 also include a “ShutDown” message 358 having amessage identifier of 25, which represents a request by the user todiscontinue the multiple-party communication.

Message sender process-client computer In general, the message senderprocess codes stored in the store 286 of the program memory (shown inFIG. 9) direct the microprocessor 262 to produce the persistent messages332, the non-persistent messages 334, and the control messages 336, inresponse to user input signals, function button invocations, andcombinations thereof.

Referring to FIG. 13A to FIG. 13C, a flowchart of blocks of code fordirecting the client computer processor circuit 260 (shown in FIG. 9) togenerate the messages is shown generally at 360.

Referring to FIG. 13A, the process begins at 362 when an interrupt eventsignal produced by the operating system is received by the interrupthandler 288.

Block 364 directs the microprocessor 262 to determine whether theinterrupt event signal corresponds to a “keyTyped” event 328 (shown inFIG. 10), in which case the process continues at block 366, whichdirects the microprocessor to generate the “KeyTyped” message 338 with amessage identifier value of 1, a “UID” 202 corresponding to the useridentifier of the client computer from the client table entry 200 (shownin FIG. 7), and color and font values corresponding to a color and fontcurrently selected by the user in the character formatting controls 486on the user interface. Block 366 also directs the microprocessor to readthe X and Y coordinates of the character entry position from thecharacter entry position store 294 in the RAM 266 and to place values ofthese coordinates in the “KeyTyped” message 338.

In this embodiment when a character is entered by the user, thecharacter is not displayed on the screen until the message is receivedback from the server, as described later herein. Furthermore, eachmessage includes information identifying only a single typed character.In other embodiments the message may represent more than one character.

The process then continues at block 367, which directs themicroprocessor 262 to compute a new character entry position for thenext character that will be typed by the user of the client computer. Inthis embodiment, subsequent characters are assigned X and Y coordinatesread from the character entry position store 294, and after eachsuccessive character is typed, the X coordinate is incremented (ordecremented for in some alphabets) such that the next character typedwill be displayed in an appropriate spaced apart relation to theprevious character typed. Successive typed characters thus appear in ahorizontal line and have the same Y coordinate.

When the user types a character corresponding to an “Enter” or new linecontrol character, then the Y coordinate is incremented (assuming thatthe display area 472 has an origin at the top left hand corner) suchthat the next character typed will be displayed on a new line below theprevious character or characters in an appropriate spaced apartrelation. The X coordinate is also decremented (or incremented in somealphabets) to cause the character entry position to align horizontallywith the first character in the previous line. In this embodiment, the Xcoordinate of the first character in a line is saved in the characterentry position store 294 and thus when an “Enter” or new line controlcharacter is typed the character entry position X coordinate is set tothe X coordinate of the first character in the previous line and the Ycoordinate is computed as described above.

Block 367 also directs the microprocessor 262 to update the characterentry position stored in the store 294 in accordance with the newcomputed character entry position.

The process then continues at block 384, which directs themicroprocessor 262 to write the message 338 into the client side Txbuffer 292.

If at block 364 the interrupt event signal does not correspond to a“keyTyped” event, then the process continues at block 368. Block 368directs the microprocessor 262 to determine whether the interrupt eventsignal corresponds to a “mouseDragged” event 324, in which case theprocess continues at block 370. Block 370 directs the microprocessor 262to determine whether the “LinkCreate” function invocation button 495(shown in FIG. 11) was clicked before the mouse was dragged. If the“LinkCreate” button 495 was clicked, then the process continues at block371. Block 371 directs the microprocessor 262 to generate the“MouseMove” message 346 with a message identifier value of 10, a “UID”corresponding to the user identifier for the client computer, and X andY coordinates corresponding to the new cursor location on the displayarea 472. The process then continues at block 384, which directs themicroprocessor 262 to write the message 346 into the client side Txbuffer 292.

If at block 370, the “LinkCreate” function invocation button 495 was notclicked before the mouse was dragged then the process continues at block382. Block 382 directs the microprocessor to generate the “MouseDrag”message 340 with a message identifier value of 2, a “UID” correspondingto the user identifier for the client computer, and color and widthvalues corresponding to a color and width currently selected in the lineformatting controls 484. Block 382 also directs the microprocessor toquery the operating system to retrieve starting X and Y coordinates andending X and Y coordinates corresponding to the cursor motion to placethese values in the appropriate bytes of the payload of the message 340.The process then continues at block 384, which directs themicroprocessor 262 to write the message 340 into the client side Txbuffer 292.

If at block 368 the interrupt event signal does not correspond to the“mouseDragged” event 324, then the process continues at block 372. Block372 directs the microprocessor 262 to determine whether the eventcorresponds to a “mouseClicked” event 322, in which case the processcontinues at block 374. Block 374 directs the microprocessor 262 todetermine whether the “ImageShow” function invocation button 474 (shownin FIG. 11) was clicked before the mouse click was produced. If the“ImageShow” function invocation button 474 was clicked, then the processcontinues at block 376, which directs the microprocessor to launch adialog window (not shown) for the user to pick an image to be displayedon the display area 472. The image may be represented by data stored inthe persistent data store 310 or the RAM 266 of the processor circuit260, or the image data may be stored in a location elsewhere on thenetwork 20.

The process then continues at block 377, which directs themicroprocessor 262 to upload the image data to the server processorcircuit 50. The uploading of the image data may be performed inaccordance with a conventional file upload protocol such as filetransfer protocol (FTP). Alternatively block 377 may direct themicroprocessor 262 to initiate a HTTP POST request for uploading theimage data to the server using HTTP protocol, for example. The uploaddata also includes an associated upload data identifier, such as afilename. Alternatively, block 377 may further direct the microprocessor262 to generate a unique upload data identifier, for example bycombining the client computer UID with a time and date generated by theoperating system.

If at block 374 the “ImageShow” function invocation button 474 was notclicked before the mouse click was produced, then the process continuesat block 375. Block 375 directs the microprocessor 262 to determinewhether the “Clipboard” function invocation button 488 was clickedbefore the mouse click was produced. If the “Clipboard” button 488 wasclicked, then the process continues at block 377 as described above,except that in this case the microprocessor 262 is directed to uploadthe clipboard data to the server.

Block 378 then directs the microprocessor 262 to generate the“ImageShow” message 342 with a message identifier value of 3, a “UID”corresponding to the user identifier for the client computer, and aupload data identifier corresponding to the upload data identifierassociated with the upload data, that was transmitted to the server 12at block 377. Block 378 also directs the microprocessor 262 to retrievethe X and Y coordinates of the display location where the mouse actuatorbutton was actuated in block 372, which defines the position of the topleft hand corner of the image (such as the image 475 shown in FIG. 11).Block 378 further directs the microprocessor 262 to place these valuesin the appropriate bytes of the “ImageShow” message 342. The processthen continues at block 384, which directs the microprocessor 262 towrite the message 342 into the client side Tx buffer 292. In otherembodiments the information in the “ImageShow” message may be uploadedat block 377, in which case block 378 may be omitted.

Advantageously the upload data may be screenshot image data of a desktoparea of the client computer. For example, screenshots may beconveniently produced when using the Microsoft Windows operating systemby pressing a “Print Screen” key on the keyboard to copy the entiredesktop to clipboard memory, or by pressing “Alt” and “Print Screen”keys to copy the content of an active window to the clipboard memory.Screenshot data is generally in some image data format (for example abitmap) and may be uploaded directly to the server from the clipboard orconverted into a different image format by an image conversion function(not shown).

Alternatively, the data in the clipboard memory may be formatted datacopied from a program window (for example Microsoft® Office Word orExcel). Formatted data may include formats, such as Excel spreadsheetformats for example, and such data is generally not suitable for displayas an image. Accordingly, when a user of one of the client computers 14,16, or 18 wishes to upload formatted data, the data may requireconversion into a format suitable for display as an image.

Such data conversions are generally performed by conversion functionsthat are configured to convert particular types of formatted data intoimage data. In this embodiment the conversion is performed by the server12 after the data has been uploaded from the client computer to theserver. Alternatively, the data conversion may be performed by theclient computer prior to uploading at block 377. In another alternativethe formatted data may be uploaded to the sever 12 and stored on theserver without conversion, and the data conversion may be performed oneach of the client computers after the formatted data is downloaded fordisplay on the respective display areas 472.

Whether the data conversion occurs on the client computers or theserver, the conversion generally involves determining a formatted datatype by reading clipboard parameters associated with the data in theclipboard memory. An appropriate conversion function is then selectedfrom a plurality of conversion functions available and the formatteddata is converted into an image format suitable for display in the userinterface 470. Advantageously, when the data conversion is performed onthe server 12, only the server need be configured to perform such dataconversions. In other embodiments where it is desired to offload thedata conversion load from the server, conversion functions may beincluded in the user interface 282 program codes, and launched whenperforming an upload of formatted data to the server 12 or whendownloading formatted data from the server.

Advantageously, the clipboard function invocation facilitates sharingcontent produced by other software applications during themultiple-party communication. All client computers will display theresulting image and will be able to draw lines and type characters overthe image.

If at block 375 the “Clipboard” function invocation button 488 was notclicked before the mouse click was produced, then the process continuesat block 380. Block 380 directs the microprocessor 262 to determinewhether the “mouseClicked” event (at block 372) was immediately precededby a “mouseDragged” event 324, in which case the process continues atblock 381. Block 381 directs the microprocessor 262 to determine whetherthe “LinkCreate” function invocation button 495 (shown in FIG. 11) wasclicked before the mouse was dragged. If at block 381 the “LinkCreate”button 495 was clicked, then the process continues at block 385. Block385 directs the microprocessor 262 to launch a dialog box for a user toenter a link identifier to be associated with a linked area 497. Forexample, the link identifier may include a filename identifying alocation and name of a client saved content in the client saved contentstore 100 on the server hard drive 58 (shown in FIG. 2). Alternatively,the link identifier may be a Uniform Resource Locator (URL) of anotherweb site (for example www.google.com).

The process then continues at block 386, which directs themicroprocessor 262 to generate the “LinkCreate” message 344 with amessage identifier value of 4, a “UID” corresponding to the useridentifier for the client computer, and the link identifier provided bythe client computer user. Block 386 also directs the microprocessor 262to query the operating system to retrieve starting X and Y coordinatescorresponding to starting coordinates of the mouse drag, and ending Xand Y coordinates corresponding to the ending coordinates of the mousedrag. Block 386 further directs the microprocessor 262 to write theretrieved coordinate values to appropriate bytes of the message 346. Thestarting X and Y coordinates and ending X and Y coordinates define thelinked area 497 on the display area 472 shown in FIG. 11. The processthen continues at block 384, which directs the microprocessor 262 towrite the message 344 into the client side Tx buffer 292.

If at block 380 the event does not correspond to a “mouseDragged” event324 then the process continues at block 388. When a “mouseClicked”interrupt event signal has been generated by the operating system atblock 372, block 388 directs the microprocessor 262 to determine whetherthe mouse click was within one of the linked areas 497 defined byinformation stored in the store 296 of the RAM 266 (shown in FIG. 9). Ifthe click was in a linked area 497 then the process continues at block389, which directs the microprocessor 262 to generate the “Open” message352 with a message identifier value of 22, a “UID” corresponding to theuser identifier for the client computer, and a link identifiercorresponding to a filename or internet address associated with thelinked area 497. The process then continues at block 384, which directsthe microprocessor 262 to write the message 352 into the client side Txbuffer 292.

If at block 388, a linked area was not clicked the process continues atblock 400, which directs the microprocessor 262 to save a coordinateposition at which the display area 472 was clicked to the characterentry position store 294 in the RAM 266, thus changing the coordinatesfor the character entry position for the next character that is enteredby the user.

The character entry position stored in the store 294 is initially set toa default position for character entry, such as location (10, 10) on thedisplay area 472, for example (i.e. 10 pixels down and 10 pixels to theright from the top left hand corner of the display area 472). When theuser of the client computer subsequently clicks on the display area 472without first pressing the “ImageShow”, “Clipboard”, or

“LinkCreate” function invocation buttons 474, 488, or 495 respectively,then the coordinates where the user clicked are saved in the characterentry position store 294 and used as the next character entry position,when the user of the client computer types a character.

Advantageously the character entry position is implemented as a “sticky”position, which causes user input characters to be displayed on thedisplay area 472 at the last character entry position saved in the store294, or the default position if the user has not set a previouscharacter entry position by clicking on the display area 472 withoutclicking first on the “ImageShow”, “Clipboard”, or “LinkCreate” functioninvocation buttons 474, 488, or 495 respectively.

If at block 372 the event does not correspond to a MouseClicked event,or at block 381 the “LinkCreate” function invocation button was notclicked before the mouse was dragged, then the process continues atblock 402 on FIG. 13B.

Referring to FIG. 13B, block 402 directs the microprocessor 262 todetermine whether the interrupt event signal corresponds to a“mouseMoved” event 326 (shown in FIG. 10), in which case the processcontinues at block 404. Block 404 directs the microprocessor 262 togenerate the “MouseMove” message 346 with a message identifier value of10, a “UID” corresponding to the user identifier for the clientcomputer, and X and Y coordinates corresponding to the new cursorlocation on the display area 472. The process then continues at block384, which directs the microprocessor 262 to write the message 346 intothe client side Tx buffer 292.

The client computer user's pointing device movements may be representedin real time by a cursor displayed by the operating system on the clientcomputer display area 472 or by a stylus tip on a touch screen displayarea. Advantageously, the “MouseMove” message 346 facilitatestransmitting the client computer user's pointing device movements toother client computers, which facilitates display of pointerscorresponding to each of a plurality of client computers on therespective display areas 472 of the other client computers who havejoined the multiple-party communication. The client computer thatgenerates the “MouseMove” message 346 also receives a copy of themessage back from the server, which facilitates display of a localpointer in addition to any cursor that may be displayed by the operatingsystem. Advantageously, display of a cursor and a local pointer permitsthe client computer user to view the effect of their pointer movements,since while the cursor responds to pointing device movements in nearreal-time, the pointer only moves once the message representing themovement is received back from the server.

Accordingly, when the pointing device is moved, the pointer generallytrails the cursor, providing a useful view of a network latencyassociated with a round trip from one of the client computers 14, 16, or18 to the server 12 and back again to the client computer. When thepointing device is not moving, the cursor and the pointer will generallybe displayed in the same location on the display area 472. For touchscreen displays where a cursor is not displayed, the stylus tip acts asa cursor and the pointer trails the stylus tip, thus providing a similarview of network latency for the user.

If at block 402 the event does not correspond to a “mouseMoved”interrupt event signal then the process continues at block 406. Block406 directs the microprocessor 262 to determine whether the user hasclicked the “ClearScreen” button 476. If the “ClearScreen” button 476has been clicked, then block 408 directs the microprocessor 262 togenerate the “ClearScreen” message 348 with a message identifier valueof 20 and a “UID” corresponding to the user identifier for the clientcomputer. The process then continues at block 384, which directs themicroprocessor 262 to write the message 348 into the client side Txbuffer 292.

If at block 406 the “ClearScreen” button 476 has not been clicked thenthe process continues at block 410. Block 410 directs the microprocessor262 to determine whether the “Save” button 477 has been clicked, inwhich case the process continues at block 412. Block 412 directs themicroprocessor 262 to launch a dialog box for receiving user input of afilename. Block 414 then directs the microprocessor 262 to generate the“Save” message 350 with a message identifier value of 21, a “UID”corresponding to the user identifier for the client computer, and afilename corresponding to the filename input by the user. The processthen continues at block 384, which directs the microprocessor 262 towrite the message 350 into the client side Tx buffer 292.

If at block 410 the “Save” button 477 has not been clicked then theprocess continues at block 416 on FIG. 13C. Referring to FIG. 13C, block416 directs the microprocessor 262 to determine whether the user hasclicked the “Open” button 494. If the “Open” button 494 has beenclicked, then block 418 directs the microprocessor 262 to launch adialog box for receiving user input of a filename. Block 420 thendirects the microprocessor to generate the “Open” message 352 with amessage identifier value of 22 and a “UID” corresponding to the useridentifier for the client computer. The process then continues at block384, which directs the microprocessor 262 to write the message 352 intothe client side Tx buffer 292.

If at block 416 the “Open” button 494 has not been clicked, then theprocess continues at block 422. Block 422 directs the microprocessor 262to determine whether either of the “PageBack” or “PageForward” buttons478 or 480 has been clicked, in which case the process continues atblock 424. Block 424 directs the microprocessor 262 generate the“PageChange” message 354 with a message identifier value of 23, a “UID”corresponding to the user identifier for the client computer, and a“PageFlag” value of “0” where the “PageBack” button was clicked or “1”where the “PageForward” button was clicked. The process then continuesat block 384, which directs the microprocessor 262 to write the message354 into the client side Tx buffer 292.

If at block 422 the “PageBack” button 478 or the “PageForward” button480 have not been clicked then the process continues at block 426. Block426 directs the microprocessor 262 to determine whether the “Quit”button 482 has been clicked, in which case the process continues atblock 428. Block 428 directs the microprocessor 262 to open a dialogwindow (for example a checkbox dialog form—not shown) to present theuser with an option of disconnecting the client while keeping themultiple-party communication running or shutting down the multiple-partycommunication.

The process then continues at block 430, which directs themicroprocessor 262 to determine whether the user has chosen todisconnect, in which case block 432 directs the microprocessor 262 togenerate the “Disconnect” message 356 with a message identifier value of24 and a “UID” corresponding to the user identifier for the clientcomputer. The process then continues at block 384, which directs themicroprocessor 262 to write the message 356 into the client side Txbuffer 292.

If at block 430 the user has chosen to shut down the meeting, then theprocess continues at block 434, which directs the microprocessor 262 togenerate the “ShutDown” message 358 with a message identifier value of25 and a “UID” corresponding to the user identifier for the clientcomputer. As will be described later herein, the request to shut downthe communication is only accepted by the server 12 if the user is thelast client computer in the communication. The process then continues atblock 384, which directs the microprocessor 262 to write the message 358into the client side Tx buffer 292.

If at block 426 the “Quit” button 482 on the user interface has not beenclicked, then the process continues at block 362 on FIG. 13A, whichdirects the microprocessor 262 to wait for the next interrupt (i.e. theevent is ignored).

From the above description, it will be appreciated that when the clientcomputer receives user input signals and/or function invocation signalsrepresenting a function invocation at the client computer, the clientcomputer produces a message having a message type associated with one ofa plurality of pre-defined combinations of the user input signals andfunction invocation signals and transmits the message to the server 12.The process 360 shown in FIG. 13A-13C thus represents a pre-associationof certain combinations and/or sequences of user input signals andfunction invocations that produce messages having one of the persistent,non-persistent and control message type. Other user input signals andcombinations such as mouse click events outside the user interface, areignored by the message sender process.

Message Transmission to the Server

Referring to FIG. 14, a flowchart of blocks of code for directing theprocessor circuit 262 (shown in FIG. 9) to transmit the messages storedin the client side Tx buffer 292 is shown generally at 440.

In general messages may be transmitted in accordance with any messagetransmission protocol, such as TCP/IP, user datagram protocol (UDP), orXML, for example.

The process begins at block 442, which directs the microprocessor 262 todetermine whether there are any messages in the client side Tx buffer292, in which case block 444 directs the microprocessor 262 to read thenext message in the Tx buffer on a first-in-first-out (FIFO) basis andto write the message to the interface 272. The interface 272 thenproduces a data signal representing the message at the input/output 274,which is transmitted to the server 12 through the network 20. Theprocess 440 then returns to block 442, repeating blocks 442 and 444until all messages in the client side Tx buffer are transmitted.

If at block 442, there are no messages in the client side Tx buffer 292,then the microprocessor 262 is directed back to block 442, which againdetermines whether any messages have been written into the client sideTx buffer 292.

Server Receive Process

A flowchart of blocks of code for directing the processor circuit 50(shown in FIG. 2) to receive input messages from each of the clientcomputers 14, 16 and 18 is shown in FIGS. 15A and 15B generally at 500.

In general, client manager threads are executed for each of the clientcomputers 14, 16, and 18 to separately receive input messages in therespective server side Rx buffers for the client computers. Referring toFIG. 15A, the process begins at blocks 502, 504 and 506, which directthe microprocessor 52 wait for input messages to be received from any ofthe client computers 14, 16, and 18 at any of the server side Rx buffers92 in the RAM 56.

The process then continues at block 508 when an input message isreceived at 502, 504, or 506. Block 508 then directs the microprocessor52 append a timestamp to the input message (after byte 30, shown in FIG.12).

Block 510 then directs the microprocessor 52 to produce an outputmessage by inserting the message in the shared buffer 88 (shown in FIG.3) at a next message store 120 after the message store referenced by the“CurrentPointer” 124. Block 510 further directs the microprocessor 52 toupdate the “CurrentPointer” 124 to reference the message store 120 inthe shared buffer to which the output message was written, such that the“CurrentPointer” always points to the last message written to the sharedbuffer 88.

In this embodiment, the output messages are produced by copying theinput message into the shared buffer. In other embodiments, outputmessages having different message identifiers or differing format to theinput messages may be produced, as described above.

In this embodiment the input messages each represent one user inputcombination (for example a mouse drag or a character typed) and theoutput messages produced represent the same user input combination.However, in other embodiments, the input messages may represent severaluser input combinations and the output message produced by the servermay represent the same user input combinations, or may combine userinput combinations in a plurality of input messages into a singe outputmessage.

Block 512 then directs the microprocessor 52 to determine the messagetype associated with the input message, by reading the messageidentifier. In this embodiment, since the output message is a copy ofthe corresponding input message the message type may be determined byreading the message identifier in either the input message or the outputmessage.

The process then continues at block 514, which directs themicroprocessor 52 to determine whether the message is a control typemessage (i.e. the message identifier 20). If the message is not acontrol type message then it is either a persistent or non-persistentmessage type and the microprocessor 52 is directed back to 502, 504, and506 to wait for the next message to be received in the respective Rxbuffers.

In general, input messages of the persistent message type and thenon-persistent message type do not require further processing by theserver 12. For example, in this embodiment cursor messages received atthe server representing “MouseDrag” and “MouseMove” user input signalsare copied into the shared buffer 88 as pointer messages, which do notrequire execution of server functions other than transmitting to theclient computers.

If at block 514 the message identifier is greater than or equal to 20,then the message is a control message which directs the server toexecute a server function. The process then continues at block 516,which directs the microprocessor 52 to determine whether the messageidentifier is 20, which corresponds to the “ClearScreen” message (Shownin FIG. 12 at 348). If the message identifier is 20, then the processcontinues at block 518, which directs the microprocessor 52 to set the“StartPointer” 122 (shown in FIG. 3) to refer to a memory store 120 inthe shared buffer 88 after the location at which the “ClearScreen”message was inserted.

Advantageously, by changing the “StartPointer” 122 to refer to thelocation after the “ClearScreen” message, client computers joining themultiple-party communication only receive messages subsequent to thelast “ClearScreen” message, thus avoiding displaying a plurality ofpersistent messages in quick succession followed by a “ClearScreen”message, which may clear the screen before the user has had time to viewthe content on the display area 472.

Alternatively in other embodiments, the “StartPointer” 122, the“CurrentPointer” 124 and the “Client SentPointers” 126 may be set tonil, as they were when communication just started. This will have theeffect of overwriting all messages in the shared buffer 88. Accordingly,in this alternative embodiment, the shared buffer 88 may be saved topersistent memory prior to overwriting any previous messages.

If at block 516 the message identifier is not 20, then the processcontinues at block 520, which directs the microprocessor 52 to determinewhether the message identifier is 21, which corresponds to the “Save”message (Shown in FIG. 12 at 350). If the message identifier is 21, thenthe process continues at block 522, which directs the microprocessor 52to copy all persistent messages (i.e. the messages having a messageidentifier <10) from the shared buffer 88 to the client saved contentstore 100 on the server hard drive 58. In this embodiment, only thepersistent type messages are saved to the hard drive in response to theclient save message. Client saved content may be saved in a server pagestorage format, described later herein.

If at block 520 the message identifier is not 21, then the processcontinues at block 524, which directs the microprocessor 52 to determinewhether the message identifier is 22, which corresponds to the “Open”message (Shown in FIG. 12 at 352). If the message identifier is 22, thenthe process continues at block 526, which directs the microprocessor 52to save the shared buffer 88 in the communication page store 104 of theserver hard drive 58 and then to clear the shared buffer by setting boththe “StartPointer” 122 and the “CurentPointer” 124 to nil, which has theeffect of causing further messages to overwrite previously savedmessages in the shared buffer 88.

Server Page Storage Format

In general, when one of the client computers transmits a control messagesuch as the “ClearScreen”, “Open”, “PageChange”, “Disconnect” or“Shutdown” control messages, messages in the shared buffer 88representing content displayed on the display area 472 are written tothe server hard drive 58 as pages under control of the page manager,which is instantiated by launching the program codes 74 in the severprocessor circuit 50 shown in FIG. 2, as described earlier herein. Thepage manager handles paging requests by causing messages to be saved onand/or read from the communication page store 104 on the server harddrive 58, without the client computer users having to enter anyfilenames. In order to maintain a complete record of the multiple-partycommunication, all persistent, non-persistent and control messages aresaved by the page manager when a page change request is received fromone of the client computers.

A page thus generally includes a plurality of messages that definecontent on the display area (and which may be retransmitted to re-createthe content, if desired).

In this embodiment, the communication page store 104 includes adedicated sub-directory created in a directory structure that savescommunication pages by date and time. For example, for a communicationhaving a communication name “MyTravel” the communication pages are savedin a sub-directory “\2007-03-23\15-39-10\My Travel\”. Within the“MyTravel” directory each page has a corresponding sub-directory (forexample “\2007-03-23\15-39-10\ My Travel\Page1\ and/or“\2007-03-23\15-39-10\My Travel\Page2\”).

For example, if the current page is Page 2, and a control message isreceived that will result in a new page being displayed (by an “Open”,“PageChange” or “Quit” message, for example) messages are saved to the“\2007-03-23\15-39-10\My Travel\Page2\” sub-directory.

If during the communication Page 2 is again displayed, and content addedto the page, then the original page is saved to a file in the “Page 2”subdirectory under a filename “Paget-1”, or “Paget-2”. Alternatively, insome communications memory allocated to the shared buffer 88 may belimited, and when the sheared buffer is overwritten, content is firstwritten to a Page file such as “Paget-3”, for example.

Thus, in this case, the directory “\2007-03-23\15-39-10\My Travel\Page2\will include files Paget-1, Paget-2, and Page3-3.

Each of the files (e.g. Page2-1, Paget-2, and Page3-3) includes one ormore messages separated by the zero terminator (#0 or byte 30 of themessages shown in FIG. 12). Each file further includes a headerincluding identifier information such as, when the file was created, thenumber of clients in the communication, the communication name &password, and other parameters associated with the communication. Forexample the file may include the following header in a text format:

-   -   FileCreated=14-34-23    -   NumberOfUsers=5    -   CommunicationName=My Travel    -   Password=travel    -   #0    -   <messages>

The “#0” zero terminator is followed by a plurality of messages, eachbeing separated from the next message by the zero terminator.

Still referring to FIG. 15A, block 526 further directs themicroprocessor 52 to generate a clear screen message (message 348 shownin FIG. 8) and to load the message into the shared buffer 88 fortransmission to the client computers 14, 16 and 18. The clear screenmessage 348 causes content associated with messages previouslytransmitted to the respective client computers 14, 16, and 18 to becleared, when the message is received at the respective clientcomputers. Block 526 also directs the microprocessor 52 to read thenumber of pages from the “List of Pages” field 194 (shown in FIG. 6) andto set the “Current Page” field 196 to a next number in sequence, toupdate the “List of Pages” field 194, thus creating new page on theserver as described above.

Block 526 further directs the microprocessor 52 to read the filename inthe message and to load messages saved under the filename from theclient saved content store 100 into the shared buffer 88, to set the“StartPointer” 122 to reference the first loaded message. As the sharedbuffer 88 is loaded with subsequent messages read from the page file,the “CurrentPointer” 124 is incremented to reference the last loadedmessage store 120. Block 526 also directs the microprocessor 52 to setthe “Catch UpFlag” to active and the SentPointer to nil, so that allclient computers catch up with the newly opened page.

If at block 524, the message identifier is not 22, then the processcontinues at block 528 on FIG. 15B. Referring to FIG. 15B, block 528directs the microprocessor 52 to determine whether the messageidentifier is 23, in which case the control message is a “PageChange”Message (shown in FIG. 12 at 354). If the message is a “PageChange”message, then the process continues at block 530, which directs themicroprocessor 52 to read the “PageFlag” in the message. If the“PageFlag” is “0” then the process continues at block 532, which directsthe microprocessor 52 to determine whether the current displayed page(identified by the current page field 196 shown in FIG. 6) is the firstpage in the “List of Pages” field 194 in the communication table entry180 (shown in FIG. 6). If the current displayed page is the first pagethen no action is taken and the microprocessor 52 is directed back toblocks 502, 504, and 506.

If at block 532 the current displayed page is not the first page thenthe process continues at block 534, which directs the microprocessor 52to save the shared buffer 88 associated with the current displayed pagein the communication page store 104 on the hard drive 58, clear thecontents of the shared buffer 88 by setting both the “StartPointer” 122and the “CurentPointer” 124 to nil, and then to decrement the “CurrentPage” field 196 to point to the new page to be displayed. Block 534further directs the microprocessor 52 to generate a clear screen message(i.e. the message 348 shown in FIG. 8) and to load the message into theshared buffer 88 for transmission to the client computers 14, 16 and 18.The clear screen message 348 is operable to clear content associatedwith messages previously transmitted to the respective client computers14, 16, and 18 when received at the respective client computers.

The process then continues at block 536, which directs themicroprocessor 52 to read the saved page corresponding to the “CurrentPage” field 196 from the communication page store 104 on the server harddrive 58 into the shared buffer 88. Block 536 also directs themicroprocessor 52 to set the “CatchUpFlag” to active and to set the“SentPointer” to “nil”. This has the effect of transmitting all messagesloaded in the shared buffer to each of the client computers 14, 16 and18, since each user must “catch up” with the changed page.

If at block 530 the “PageFlag” is not “0” then the “PageFlag” is “1” andthe process continues at block 538, which directs the microprocessor 52to determine whether the current displayed page is the last page in the“List of Pages” field 194, in which case the process continues at block540. Block 540 directs the microprocessor 52 to save the shared buffer88 associated with the current page in the communication page store 104on the hard drive 58 and clear the contents of the shared buffer 88 bysetting both the “StartPointer” 122 and the “CurentPointer” 124 to nil.Block 540 also directs the microprocessor 52 to increment the “CurrentPage” field 196 to point to the new current page to be displayed, to setthe “CatchUpFlag” to active, and to set the “SentPointer” to “nil”.Block 540 further directs the microprocessor 52 to generate a clearscreen message (i.e. the message 348 shown in FIG. 8) and to load themessage into the shared buffer 88 for transmission to the clientcomputers 14, 16 and 18. The clear screen message 348 is operable toclear content associated with messages previously transmitted to therespective client computers 14, 16, and 18 when received at therespective client computers. The codes in block 540 essentially causethe server to generate a new blank page.

If at block 538, the current displayed page is not the last page thenthe process continues at block 542, which directs the microprocessor 52to save the shared buffer 88 associated with the current displayed pagein the communication page store 104 on the hard drive 58, to clear thecontents of the shared buffer 88 by setting both the “StartPointer” 122and the “CurentPointer” 124 to nil, and then to increment the “CurrentPage” field 196 to point to the new page to be displayed. Block 542further directs the microprocessor 52 to generate a clear screen message(i.e. the message 348 shown in FIG. 8) and to load the message into theshared buffer 88 for transmission to the client computers 14, 16 and 18.The clear screen message 348 is operable to clear content associatedwith messages previously transmitted to the respective client computers14, 16, and 18 when received at the respective client computers. Theprocess then continues at block 536 as described above.

If at block 528 the message identifier is not 23, then the processcontinues at block 544, which directs the microprocessor 52 to determinewhether the message identifier is 24, in which case the messagecorresponds to the “Disconnect” message (shown in FIG. 12 at 356). Ifthe message identifier is 24, then the process continues at block 546,which directs the microprocessor 52 to set the “KeepRunningIdleFlag” 188in the communication table 80 to active.

The process then continues at block 548, which directs themicroprocessor 52 to remove the client corresponding to the “UID” in themessage from the client table 90 in the RAM 56 and to delete the Rx andTx buffers for the client computer.

The process then continues at block 550, which directs themicroprocessor 52 to determine whether the client table is empty (i.e.there are no more clients in the multiple-party communication). If theclient table is empty then the process continues at block 552, whichdirects the microprocessor 52 to determine whether the“KeepRunningIdleFlag” flag 188 in the communication table 80 is active(which it will be in this case due to block 546 having been executed),in which case the process continues at block 558 and the multiple-partycommunication is suspended. However the communication table entry 180(shown in FIG. 6) remains in the communication table 80 in the RAM 56,and client computer users may still join the multiple-partycommunication at a later time.

If at block 550 the client table is not empty, then the multiple-partycommunication should continue for other client computers still in themultiple-party communication, in which case the microprocessor 52 isdirected back to blocks 502, 504, and 506 in FIG. 15A.

If at block 544 the message identifier is not 24, then the processcontinues at block 554, which directs the microprocessor 52 to determinewhether the message identifier is 25, in which case the message is a“ShutDown” message (shown in FIG. 12 at 358). The process then continuesat block 556, which directs the microprocessor 52 to set the“KeepRunningIdleFlag” flag to not active.

The process then continues at blocks 548 and 550, as described above. Ifat block 552, the “KeepRunningIdleFlag” flag 188 is not active (which itwill be in this case due to block 556 having been executed), then theprocess continues at block 560. Block 560 directs the microprocessor 52to save the shared buffer in the communication page store 104 on theserver hard drive 58, to delete the shared buffer 88 from RAM 56, and todelete the communication table entry 180 from the communication table80. This has the effect of shutting down the multiple-partycommunication. However a record of all multiple-party communicationmessages (persistent and non-persistent) remains saved in thecommunication page store 104 on the server hard drive 58.

Server Upload of Data

When one of the client computer users invokes either the “ImageShow” orthe “Clipboard” functions by clicking on the function invocation buttons474 or 488 and then actuating a pointing device actuator button whilethe cursor is within the display area 472, an upload of data isinitiated by the client computer to the server 12. In general, uploaddata is received by the server 12 and stored in the upload data store106 on the server hard drive 58. Alternatively the upload data may bestored in an upload data store (not shown) in the RAM 56.

In the embodiment shown, the user interface embodiment shown in FIG. 11may not be capable of displaying certain types of data that may beuploaded from client computer clipboard memory to the server, such asformatted data from other application programs, for example. Accordinglywhen the server 12 receives upload data (for example as an HTTP POSTrequest from a client computer), the server reads the data to determinewhether the upload data requires conversion. If the upload data isalready in a supported image format then no conversion is required andthe data is stored in the upload data store 106 and associated with thedata identifier. If the upload data is not of a supported image format,the server invokes a conversion function to convert the upload data intoa supported image format. Accordingly, the server may be configured witha plurality of common conversion functions covering many commonly usedformatted data types (for example Microsoft Word and Excelapplications). Conversion function program codes for producing imagedata from many formatted data types are generally available for licenseby software vendors and third party vendors.

Server Transmit Process

Referring to FIG. 16 a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to process messages in the sharedbuffer 88 for transmission to the client computers 14, 16 and 18 isshown generally at 580. The process 580 is executed by themicroprocessor 52 for each of the client computers 14, 16, and 18 andmessages are loaded into each of the respective Tx buffers 94 in theserver RAM 56.

The process begins at block 584, which directs the microprocessor 52 todetermine whether the “SentPointer” 126 (shown in FIG. 3) for the clientcomputer is equal to the “CurrentPointer” 124. If the “SentPointer” 126is equal to the “CurrentPointer” 124, then the process continues atblock 586, which directs the microprocessor 52 to determine whether the“CatchUpFlag” 208 is active for the client computer. If the“CatchUpFlag” is active, then block 588 directs the microprocessor 52 toset the “CatchUpFlag” 208 to not active, since the client computer has“caught up” with the multiple-party communication. The microprocessor 52is then directed back to block 584, and the process 580 is repeated.

If at block 584 the “SentPointer” 126 is not equal to the“CurrentPointer” 124 then the process continues at block 590, whichdirects the microprocessor 52 to determine whether the messageidentifier for the message in the next shared buffer store after thestore indicated by the “SentPointer” is less than 10, indicating thatthe message is a persistent message. If the message identifier is lessthen 10, then the process continues at block 592, which directs themicroprocessor 52 to load the message referenced by the “SentPointer”210 (shown in FIG. 7) into the Tx buffer 94 corresponding to the client.Advantageously, in this embodiment, all client computers that havejoined the multiple-party communication receive output messages that areassociated with the persistent message type.

The process then continues at block 596, which directs themicroprocessor 52 to update the “SentPointer” for the client to indicatethat the message has been transmitted to the client computer. Themicroprocessor 52 is then directed back to block 584, and the process580 is repeated.

If at block 590 the message identifier is greater than or equal to 10,then the message is a non-persistent or control message and the processcontinues at block 594, which directs the microprocessor 52 to determinewhether the “CatchUpFlag” for the client computer is set active. If the“CatchUpFlag” is not active then the process continues at block 592 asdescribed above the non-persistent and/or control message is transmittedto the client computer.

Advantageously, when the “CatchUpFlag” is set active for a clientcomputer, the client computer does not meet the criterion fortransmission of the message and the non-persistent and control messageare not transmitted to the corresponding client computer. If at block594 the “CatchUpFlag” is active, then the process continues at block596, as described above.

Referring to FIG. 17 a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to transmit messages from theserver side Tx buffers 94 (for each of the client computers 14, 16 and18) is shown generally at 597. The process begins at block 598, whichdirects the microprocessor 52 to determine whether there are anymessages in the Tx buffer. If there are messages in the Tx buffer to besent, then the process continues at block 600, which directs themicroprocessor 52 to write the messages to the network interface 62 ofthe I/O port 60. The process then continues at block 598, thus repeatingblocks 598 and 600.

If at block 598 there are no further messages to be transmitted to theclient then the process repeats block 598.

Advantageously, only clients that meet the criterion of being “caughtup” with the multiple-party communication are transmitted thenon-persistent messages in order to avoid sending generally confusingnon-persistent mouse movements to clients who have joined themultiple-party communication late. Once the client has caught up withthe multiple-party communication the client then receives allnon-persistent messages representing their own pointer movements as wellas pointer movements of other clients in the multiple-partycommunication.

In the embodiment shown in FIG. 16 control messages will also betransmitted to the client computers, since control messages are alsostored in the shared buffer. As will be seen later, with the exceptionof the “ClearScreen” message, the control messages transmitted to theclients do not result in any changes to the client display area 472 andare generally ignored by the client computers.

Messages loaded into the Tx buffers 94 of the respective clientcomputers are transmitted to the client computers through the network 20in the order in which they are loaded into the buffer (i.e. on afirst-in-first-out FIFO basis).

Client Receive Process

In general, the message receiver program codes stored in the store 284of the program memory (shown in FIG. 9) direct the microprocessor 262 toreceive and process messages transmitted to the client computer 14, 16,and 18 from the server 12.

Referring to FIG. 18A a flowchart of blocks of code for directing theprocessor circuit 260 (shown in FIG. 9) to receive messages from theserver 12 is shown generally at 620. The process 620 starts at block 621when a message is received at the interface 272 of the I/O port 270.

Block 622 then directs the microprocessor 262 to write the message intothe client side Rx buffer 290 (shown on FIG. 9). Block 623 then directsthe microprocessor 262 to read the message identifier (MID) and clientcomputer identifier (UID) included in the message.

The process continues at block 624, which directs the microprocessor 262to determine whether the message identifier is 1. If the messageidentifier is 1, then the message corresponds to the “KeyTyped” message338 (shown in FIG. 12), and the process continues at block 626, whichdirects the microprocessor 262 to read the bytes in the messagecorresponding to color, font identifier, font style identifier, fontsize, the character to be displayed, and the X and Y coordinates of theposition at which to display the character. The process then continuesat block 628, which directs the microprocessor 262 to call a function inthe image display program codes 289 for drawing the character on thedisplay area 472.

If at block 624, the message identifier is not 1, then the processcontinues at block 630, which directs the microprocessor 262 todetermine whether the message identifier is 2. If the message identifieris 2, then the message corresponds to the “MouseDrag” message 340, whichis a pointer message. Block 631 then directs the microprocessor 262 toread the bytes in the message corresponding to color, line width,starting coordinates Xold and Yold, and ending coordinates Xnew andYnew.

Block 632 then directs the microprocessor 262 to call a function in theimage display program codes 289 for drawing a line of specified colorand width between the starting X and Y coordinates and the ending X andY coordinates on the display area 472.

The process then continues at block 633 which directs the microprocessor262 to determine whether the UID read in block 631 matches one of theUID's in the pointer table 295 stored in the RAM 266. The pointer table295 includes an entry (not shown) for each client computer in themultiple-party communication and each entry includes the UID and thecurrent X and Y coordinate position of the pointer associated with theUID. If none of the pointer table entries has a UID that matches the UIDread at block 631, then the process continues at block 635, whichdirects the microprocessor 262 to add a new entry (i.e. UID, Xnew, Ynew)to the pointer table 295.

The process then continues at block 637, which directs themicroprocessor 262 to call a function in the image display program codes289 to cause a pointer associated with the UID to be displayed at theXnew and Ynew coordinate position on the display area 472.

If at block 633 the UID read in block 631 matches one of the pointertable entries, then the process continues at block 634, which directsthe microprocessor 262 to call a function in the image display programcodes 289 for moving the image of the pointer from its current position(read from the pointer table) to the Xnew and Ynew coordinate positionon the display area 472. Block 648 also directs the microprocessor 262to update the coordinate position in the pointer table 295 for thepointer associated with the UID read at block 631 to the new coordinatesXnew and Ynew.

If at block 630, the message identifier is not 2, then the processcontinues at block 636, which directs the microprocessor 262 todetermine whether the message identifier is 3. If the message identifieris 3 then the message corresponds to the “ImageShow” message format 342.Block 638 then directs the microprocessor 262 to read the bytes in themessage corresponding to the data identifier of the image, and the X andY coordinates at which an upper left hand corner of the image is to bepositioned on the display area 472. Block 640 then directs themicroprocessor 262 to download the data associated with the dataidentifier from the server 12. Downloading may be performed inaccordance with any conventional file download protocol such as filetransfer protocol (FTP), for example. Alternatively block 640 may directthe microprocessor 262 to initiate an HTTP GET request to cause theimage file to be downloaded to the client computer from the server 12.

The process then continues at block 642, which directs themicroprocessor 262 to call a function in the image display program codes289 for displaying the image at the X and Y coordinates on the displayarea 472.

If at block 636, the message identifier is not 3, then the processcontinues at block 637 on FIG. 18B. Referring to FIG. 18B, block 637directs the microprocessor 262 to determine whether the messageidentifier is 4. If the message identifier is 4, then the messagecorresponds to the “LinkCreate” message format 344, in which case block639 then directs the microprocessor 262 to read the bytes in the messagecorresponding to the “UID”, the X1, Y1, X2, and Y2 coordinatesrepresenting coordinate positions of corners of the linked area 497(shown in FIG. 11), and the filename or internet address in the message344.

The process then continues at block 641, which directs themicroprocessor 262 to store the filename or internet address andcoordinates X1, X2, Y1, and Y2 in the filename/URL store 296 in the RAM266 (shown in FIG. 9). As described above in connection with block 388(shown in FIG. 13A), a mouse click occurring within one of the linkedareas defined by hyperlink information stored in the store 296 causesthe associated filename or internet address to be opened in the displayarea 472.

If at block 637, the message identifier is not 4, then the processcontinues at block 644, which directs the microprocessor 262 todetermine whether the message identifier is 10. If the messageidentifier is 10, then the message corresponds to the “MouseMove”message format 346, which is a pointer message. Block 645 then directsthe microprocessor 262 to read the bytes in the message corresponding tothe “UID”, and the Xnew and Ynew coordinates representing the endingposition of the mouse pointer.

The process then continues at block 646 which directs the microprocessor262 to determine whether the UID read in block 645 matches one of theUID's in the pointer table 295 stored in the RAM 266. If none of thepointer table entries has a UID that matches the UID read at block 645,then the process continues at block 646, which directs themicroprocessor 262 to add a new entry (i.e. UID, Xnew, Ynew) to thepointer table 295.

The process then continues at block 649, which directs themicroprocessor 262 to call a function in the image display program codes289 to cause a pointer associated with the UID to be displayed at theXnew and Ynew coordinate position on the display area 472.

If at block 646 the UID read in block 645 matches one of the pointertable entries, then the process continues at block 648, which directsthe microprocessor 262 to call a function in the image display programcodes 289 for moving the image of the pointer from its current position(read from the pointer table 295) to the Xnew and Ynew coordinateposition on the display area 472. Block 648 also directs themicroprocessor 262 to update the coordinate position in the pointertable 295 for the pointer associated with the UID read at block 645 tothe new coordinates Xnew and Ynew.

Advantageously, when the client computer receives its own “MouseMove”messages back from the server as pointer messages, the client computerdisplays a pointer corresponding to the pointer message. Accordingly, inthis embodiment, the client computer may display a cursor representing acurrent (real time) position of the client computer pointing device andfurther displays the pointer corresponding to its own “MouseMove”messages, which represent the position of the client computer's pointingdevice as seen by the server 12 and the other client computers in themultiple-party communication. Each client computer is thus provided withfeedback by receiving their own pointer message, which causes display oftheir own pointer on their display.

Furthermore, by displaying both the client computer cursor, the clientcomputer's pointer, and the other client computer pointers on each ofthe client computer's respective display areas 472, an awareness of whatother users are doing during the multiple-party communication isprovided. For example the user of the client computer 14 may cause theircursor 496 to move to point to specific content displayed on the displayarea 472 and the users of other client computers 16 and 18 will seecorresponding movements of the pointer 499 corresponding to the clientcomputer 14 on their respective displays. The user of client computer 14will also be able to view their own pointer in relation to their cursor,which may be useful for guiding the user's actions.

If at block 644, the message identifier is not 10, then the processcontinues at block 654, which directs the microprocessor 262 todetermine whether the message identifier is 20. If the messageidentifier is 20, then the message corresponds to the “ClearScreen”message format 348. Block 656 then directs the microprocessor 262 tocall a function in the image display program codes 289 for clearing thedisplay area 472.

If at block 654 the message identifier is not 11, then the message isignored and the microprocessor 262 is directed back to block 621 to waitfor the next message to be received. It should be readily appreciatedthat control messages having a message identifier of 20 received by theclient computer 14, 16, and 18 are ignored in the process 620, whichonly responds to persistent messages and non-persistent messages.

Publishing Content

In another embodiment, a user of one of the client computers 14, 16, or18 may wish to publish content created during a multiple-partycommunication to facilitate viewing by other computers in communicationwith the network 20. For example, a client computer user may wish torecord a page that may be later viewed by another user, who may not havejoined the multiple-party communication. Alternatively a client computeruser may wish to record content created in a single client communicationand then make the page(s) publicly available for viewing in similarfashion to that provided by web sites on the internet.

Referring to FIG. 11, when a client computer user clicks on the“Publish” function invocation button 493 on the user interface 470, adialogue window is displayed (not shown), which prompts the user toenter a filename under which the multiple-party communication will bepublished (for example “travel.web”). The dialogue window mayadditionally prompt the user to enter a description for the publishedpage, such as “My European Vacation”, for example. When the user entersthe filename the server processor circuit 50 (shown in FIG. 2) causesall persistent messages representing content in a currently displayedpage to be written to the published communication store 108 on theserver hard drive 58.

The “Publish” function invocation button 493 generally launches asimilar process to the process launched by the “Save” button 477 (i.e.blocks 410, 412, and 414 in FIG. 13B) except that the persistentmessages are saved to the published communication store 108 rather thanthe client saved content store 100. However, published content in thepublished communication store 108 are generally made available to anyonewho wishes to view the pages, while saved content in the client savedcontent store 100 is generally only available to client computer userswho have joined a multiple-party communication that caused therespective pages to be saved. In other embodiments, non-persistentmessages may also be saved to the published pages store to facilitatereplaying non-persistent mouse movements to the public access computer.

Viewing Published Multiple-Party Communications

Any user of a computer such as the public access computer 40 shown inFIG. 1, which has a connection to the network 20, may view a publishedmultiple-party communication. In general, the user connects to theserver 12 and transmits a request for a web page listing publishedmultiple-party communications (not shown) saved in the publishedcommunication store 108. The web page generally includes a publishedpages table that includes information similar to the information listedin table 140 on the web page 130 (shown in FIG. 4), except that eachentry corresponds to a published page rather than an activemultiple-party communication.

Alternatively, if a user knows or has been otherwise made aware of theURL under which the page was published, the user may type URL of thepublished page (for example www.freemeeting.com/travel.web) into anaddress field of an internet browser application such as MicrosoftInternet Explorer.

Referring to FIG. 19, a flowchart representing blocks of codes fordirecting the microprocessor 52 to create a communication for viewingpublished pages is shown generally at 680. The process 680 is similar tothe process 150 shown in FIG. 5, in that a communication is created forthe public access computer user, thus providing various communicationfunctions generally as described above. However the communication forviewing published content may only have single computer user as aparticipant.

Furthermore certain functions generally available in activemultiple-party communications are not necessary for viewing a publishedmultiple-party communication and such functions may be disabled, asdescribed below.

In general the server responds to a request from a public accesscomputer including an identifier identifying published contentassociated with a previous communication. The server then reads savedmessages associated with the identifier from persistent memory storageon the server and produces respective output messages representing thecontent in the saved messages. The output messages are then transmittedto the computer.

The process 680 begins at 682 when a public access computer user clickson a hyperlink to a published multiple-party communication in the webpage listing available published communication content, which causes aHTTP request message including identifier identifying the selectedpublished multiple-party communication to be transmitted to the server12. In one embodiment the identifier includes the filename under whichthe multiple-party communication was published and/or the descriptionprovided by the client computer user when the content was published.

Block 684 then directs the microprocessor 52 to read the HTTP message toextract the identifier. Block 684 also directs the microprocessor 52 tocreate a communication for viewing the content by adding a newcommunication entry to the communication table 80 (shown in FIG. 2). Inthis embodiment, communications created for viewing of published pagesare created with the “HiddenFlag” 198 set to active, such that thecommunication is not listed when the web page 130 is displayed to clientcomputer users who request information on active multiple-partycommunications as per previously described embodiments. Accordingly,since the communication name will not be displayed, the“CommunicationName’ field 184 in the communication table entry 180 maybe populated with the filename or the description read from the HTTPmessage, or may be set to a default value. A new unique communicationidentifier (CID) is also generated for the communication and stored inthe CID field 182 in the communication table 80 in the RAM 56.

Block 686 then directs the microprocessor 52 to create a new sharedbuffer 88 (shown in FIG. 2) for the communication, and to initialize the“StartPointer” 122 and the “CurrentPointer” 124 to both refer to a firststore in the shared buffer 88. Block 686 also directs the microprocessor52 to instantiate a page manager for the communication by launching thepage manager program codes in the store 74 of the program memory 54.

Block 688 then directs the microprocessor 52 to instantiate a new clientmanager for the communication by launching the client manager programcodes in the store 72 of the program memory 54.

Block 690 then directs the microprocessor 52 to generate a new clienttable 90 in the RAM 56, to add an entry to the client table for thepublic access computer. In this embodiment block 690 also directs themicroprocessor 52 to set the “CatchUpFlag” to active, such that onlypersistent type messages are transmitted to the public access computer40. In other embodiments, persistent, non-persistent, and control typemessages may be transmitted to the public access computer 40.

Block 692 then directs the microprocessor 52 to create server side Rxand Tx buffers 92 and 94 for the originating client.

Block 694 then directs the microprocessor 52 to cause the networkinterface 62 of the I/O PORT 60 to transmit published pages userinterface codes through the network 20 to the public access computer.Alternatively, the public access computer may launch program codes (notshown) for instantiating a stand-alone published pages user interfaceapplication.

Block 696 then directs the microprocessor 52 to read messages from thepublished page identified by the filename read from the HTTP message inblock 684 and to load the messages into the shared buffer. The“StartPointer” 122 is set to reference the message store 120 in theshared buffer 88 to which the first message was loaded. As the messagestores 120 of the shared buffer 88 are loaded with subsequent messagesread from the published page file, the “CurrentPointer” 124 isincremented to reference the last loaded message store.

The published pages user interface may be generally similar to the userinterface 470, except that user interface function invocation buttons474, 476, 477, 495, 488, 493, and 491, the line formatting controls 484,and the character formatting controls 486, may be disabled or notdisplayed in the user interface. Accordingly, only the “Open” functioninvocation button 494, the “PageBack” function invocation button 478,the “PageForward” function invocation button 480, and the “Quit”function invocation button 482 are still active when viewing a publishedcontent. The aforementioned function invocation buttons generallyoperate as described above in connection with FIG. 13A-FIG. 13C.

The persistent messages associated with the published page in thepublished communication store 108 are then processed generally inaccordance with the process 580 shown in FIG. 16. The output messagesare then transmitted to the public access computer in accordance withthe process 597 shown in FIG. 17.

When a public access computer user views a published multiple-partycommunication all persistent saved content and any linked areas 497 aredisplayed in accordance with the process 620 shown in FIGS. 18A and 18B.When the “CatchUpFlag” is set to not active, non-persistent content isalso displayed on the public access computer 40.

The public access client computer 40 may cause user input signals to beproduced but only certain user input signal and function invocationcombinations will be processed in accordance with the process 360 shownin FIG. 13A-FIG. 13C. For example, in this embodiment, only blocks 416,418 and 420 (“Open” function invocation), block 388, and 389 (link areaclicked), block 422 and 424 (“PageBack” and “PageForward” functioninvocations), and/or block 426-434 (“Quit” function invocation buttons)are processed by the public access computer.

If the published page includes a linked area (such as the linked area497 shown in FIG. 11), pointing device user input signals causinginterrupt event signals within the linked area cause blocks 388, 389,and 384, shown in FIG. 13A to be launched. Block 389 directs themicroprocessor 262 to generate the “Open” message 352 with a messageidentifier value of 22, and a “UID” corresponding to the user identifierfor the public access computer, and a filename or internet addressassociated with the linked area 497. The filename may be a filename ofother published messages in the published communication store 108. Theprocess then continues at block 384, which directs the microprocessor262 to write the message 352 into the client side Tx buffer 292. Thelinked areas 497 thus facilitate providing published content withfunctioning hyperlink areas to other saved messages and/or other contentavailable elsewhere on the network 20.

When the “Open” function invocation button 494 is clicked, then theblocks 416, 418 and 420 in the process 360 are launched. Block 418launches a dialog (not shown) for user to enter the filename of otherpublished content in the published communication store 108, for example“inLondon.web”. Block 420 then directs the microprocessor 262 togenerate the “Open” message 352 with a message identifier value of 22,and a “UID” corresponding to the user identifier for the public accesscomputer, and a filename entered by user in dialog box at block 418. Theprocess then continues at block 384, which directs the microprocessor262 to write the message 352 into the client side Tx buffer 292.

When either the “PageBack” function invocation button 478 or the“PageForward” function invocation button 480 is clicked, the blocks 422and 424 are launched causing a page change message to be transmitted tothe server 12. Advantageously, if more than one published page has beenviewed by the public access computer user by clicking on a linked area497, then the user is permitted to page back and forward through thesepages in accordance with the blocks 528-542 in the process 500 shown inFIG. 15B.

When the “Quit” function invocation button 482 is clicked, block 426 inthe process 360 is launched. However blocks 428, 430 and 432 are notlaunched for public access computers. When facilitating viewingpublished pages, the server 12 determines whether the communication isto keep running or be shut down.

In one embodiment, the communication created for the public accesscomputer 40 to view a published page may be shut down in accordance withblocks 548-560 shown in FIG. 15B after the published page has beentransmitted to the computer user. The published page view will remaindisplayed on the public computer display, but the communication thatfacilitated transmitting the page will be closed. Accordingly, each timethe user of the public access computer 40 requests another page byclicking on a linked area 497 on the published page, for example, a newcommunication is created to serve the requested page to the user.

In other embodiments the communication may be kept running, transmittingdifferent content files from published communication store 108 inresponse to the public access computer user requests, until the userdisconnects from the communication by clicking on the quit button, asdescribed earlier herein. This communication will only have a singleparticipant since the Hidden flag 198 is set to active so that otherclient computers cannot join the communication.

In yet another embodiment, the published multiple-party communicationcontent may be transmitted to public computer user one message at a timewith a time interval between messages corresponding to the timestampappended to the messages at block 508 in FIG. 15A as described laterherein with reference to FIG. 32. This permits the public accesscomputer user to view the published multiple-party communication contentat a rate that matches the rate at which the content was created in theoriginal multiple-party communication. In this embodiment a newcommunication may be created for each public access computer user thatwishes to view the published page at the original content creation rate,thus facilitating delayed transmission of messages from a shared bufferassociated with the communication.

In other embodiment the server may share the communication for the samepublished content between multiple public access computers, in whichcase the same communication (having the same CID) may be used to servethe published pages to second and subsequent public access computers.When the last user disconnects from the communication, the communicationmay then be shut down. Although in such shared public communications,when any user clicks on linked areas 497, “Open”, “PageBack” or“PageForward” buttons, all users of public client computers will betransmitted messages associated with the new page. This type ofmultiple-party communication is suitable when the published content doesnot have Link areas, and server also repeatedly transmits the samecontent over and over again in a repeating looped presentation.

Advantageously a public access computer user who is not capable ofproducing web pages by conventional methods (for example using MicrosoftFrontPage® or using hypertext markup language) may record content in acommunication and publish the content, thus making the pages availableto the public in general. Publishing such pages does not require anyspecialized knowledge, while providing a simple interface (i.e. the userinterface 470) for producing content including images, lines andcharacter annotations and links to other content. Accordingly, in thisembodiment, the server 12 is generally configured to act as a contentrecorder, facilitating subsequent playback of the recorded content toany computer user who is connected to the network 20. The publishedpages may be browsed by a user in the user interface in a similar mannerto browsing web pages in a web browser.

Game Piece Image Movement

In another embodiment the system for supporting multiple-partycommunications may further facilitate playing of a game between partieswho have joined a multiple-party communication.

Display of game piece images is initiated when a user of one clientcomputer user clicks on the “Game” function invocation button 491 on theuser interface 470. Image data representing the game piece images andinitial position coordinates for displaying the game piece images arestored in the store 298 of the client computer RAM 266.

Referring to FIG. 20, a flowchart of blocks of code for directing theprocessor circuit 260 (shown in FIG. 9) to generate the game message 359is shown generally at 710. The blocks in the process 710 generallyrepresent a modification to the process 360 shown in FIG. 13.

The process begins at 712, which directs the microprocessor 262 todetermine whether the “Game” function invocation button 491 has beenclicked, in which case the process continues at block 714. Block 714directs the microprocessor 262 to generate the “Game” message 359 with amessage identifier value of 5 and a “UID” corresponding to the useridentifier of the client computer that invoked the game function.

The process then continues at block 384, which directs themicroprocessor 262 to write the message 350 into the client side Txbuffer 292. The message 359 is then transmitted to the server 12 inaccordance with the process 440 shown in FIG. 14.

The server 12 receives the “Game” message 359 from the client computerin accordance with blocks 508-512 of the process 500 shown in FIG. 15 asdescribed above. Once inserted into the shared buffer at block 510 the“Game” message 359 is then processed for transmission in accordance withthe process 580 shown in FIG. 16, and transmitted to all clientcomputers in accordance with the process 597 shown in FIG. 17, asdescribed above.

Referring to FIG. 21, a flowchart representing blocks of code fordirecting each client computer processor circuit 262 to display the gamepiece images is shown generally at 720. The blocks in the process 720generally represent a modification to the process 620 shown in FIG. 18B.

The process 720 begins at block 722, which directs the microprocessor262 to determine whether the message received at block 621 in FIG. 18Ahas a message identifier of 5. If the message identifier is 5, then theprocess continues at block 724, which directs the microprocessor 262 toread game piece image data and respective position coordinates from thestore 298 and to call a function in the image display program codes 289(shown in FIG. 9) for displaying each game piece image on the displayarea 472 at positions corresponding to the respective positioncoordinates for each game piece image.

Referring to FIG. 22, a screenshot of the user interface 470 (shown inFIG. 11) is shown having a display area 740 that includes game pieceimages 742 displayed thereon. The game piece images 742 include a gameboard image 744, a plurality of white game piece images 746 and aplurality of black game piece images 748. Each of the game piece images742 are displayed at initial position coordinates read from the store298 of the client computer RAM 266. Each game piece image 746 and 748includes an image boundary 747 (shown in broken outline), which definesthe image extent of the respective game piece.

Referring back to FIG. 21, the process then continues at block 726,which directs the microprocessor 262 to write the respective positioncoordinates to the game piece coordinates store 299 in the clientcomputer RAM 266, such that subsequent movements of the game pieces bythe client computer users may be tracked in position coordinate valuesstored in the game piece coordinates store 299.

Game Piece Movements

In general, the game board image 744 is displayed at a fixed coordinateposition on the display area 740, while the game piece images 746 and748 may be moved in response to user input signals received at therespective client computers.

Referring to FIG. 23, a flowchart representing blocks of code fordirecting the microprocessor 262 to move the game piece images on thedisplay area 740 is shown generally at 770. The process 770 shown inFIG. 23 is a modification of the process 620 shown in FIG. 18A.

In this embodiment, game piece images 746 and 748 are moved in responseto cursor messages representing “MouseDragged” user input signalcombinations. In other embodiments the game piece images may be moved inresponse to cursor movement signals in combination with character inputsignals produced at the keyboard (for example, when the user presses a“Ctrl” key while simultaneously moving the pointing device.

If at block 630 the message identifier is 2, then the messagecorresponds to the “MouseDrag” cursor message 340. The process continuesat block 632, which directs the microprocessor 262 to read the bytes inthe cursor message corresponding to color, line width, startingcoordinates Xold and Yold, and ending coordinates Xnew and Ynew.

Block 772 then directs the microprocessor 262 to determine whether theposition coordinates Xnew and Ynew represent a position on the displayarea 740 that is inside the boundary 747 of one of the game piece imagesrepresented by coordinates stored in the game piece coordinates store299 in the RAM 266, in which case the process continues at block 774.

Block 774 then directs the microprocessor 262 to call a function in theimage display program codes 289 to delete the game piece image at andredraw the game piece image at a new location Xg, Yg on the displayarea. The coordinates Xg, Yg are shifted by ΔX and ΔY from a previouslocation of the game piece image, where ΔX and ΔY are calculatedaccording to the relation:

ΔX=X _(new) −X _(old)

ΔY=Y _(new) −Y _(old)  Eqn 1

Block 775 then directs the microprocessor 262 to write the new gamepiece position coordinates into the game piece coordinate store 299 inthe RAM 266.

Block 776 then directs the microprocessor 262 to determine whether theposition coordinates Xold and Yold define a position on the display area740 that is inside one of the game piece coordinate areas stored in thegame piece coordinates store in the RAM 266, in which case the processcontinues at block 648.

Block 648 then directs the microprocessor 262 to call a function in theimage display program codes 289 for moving the image of the pointer fromits current position on the display area 740 to the Xnew and Ynewcoordinate position on the display area 740.

If at block 776, the coordinates Xold and Yold define a position that isnot inside the boundary 747 of one of the game piece images 746 and 748on the display area 740 then the process continues at block 634. Block634 directs the microprocessor 262 to call a function in the imagedisplay program codes 289 for drawing a line of specified color andwidth on the user display area 740 between the starting coordinates Xoldand Yold, and ending coordinates Xnew and Ynew.

If at block 772 the coordinates Xnew and Ynew define a position that isnot inside the boundary 747 of one of the game piece images 746 and 748on the display area 740 then the process continues at block 634 and 648,as described above.

In this embodiment when the user input signals cause the clientcomputer's pointer 499 to be dragged across the boundary 747 of one ofthe game piece images 746 or 748 the pointer “pushes” the game pieceimage to a new location, while simultaneously drawing a line on thedisplay area. When the user input signals cause client computer'spointer 499 to be dragged inside the boundary 747, the game piece imageis moved without drawing a line on the display area 740. In otherembodiments the line may be discontinued when the pointer crosses theboundary 747 or the line may be drawn behind the game piece image andgame board 744.

Advantageously, the game piece images are moved in response to pointermessages received at the client computers, and not in response to thecorresponding client computer cursor 496, thus facilitating some serverarbitration of game piece movements in accordance with the timestamp ofthe messages representing game piece movements received from the clientcomputers. Should two client computer users simultaneously wish to movethe same game piece image, a first received message will receivepriority of movement. Furthermore, in this embodiment the server 12 onlyreceives cursor messages and produces pointer messages which aretransmitted to the client computers. When the client computers receivethe pointer messages, the pointer messages are interpreted by the clientcomputer processor circuit 260 to cause corresponding game piece imagemovements on each of the respective display areas 740, such that eachuser receives a common view of the game piece images 742. By causinggame piece movements in response to pointer messages rather than theclient computers real time cursor 496, the users are able to adjusttheir activity to account for any network latency when moving the gamepiece images.

Referring to FIG. 24, in an alternative embodiment, desired game piecemovements may be represented by a game piece movement request messageshown generally at 780. The piece movement request messages 780 aretransmitted by the client computers 14, 16, and 18 to the server 12 inresponse to user input signals representing movements that cross theboundary 747 or are within the boundary.

The piece movement request message 780 is a persistent message having amessage identifier of 6. The piece movement request message 780represents a “MouseDrag” combination of user input signals betweenstarting X and Y coordinates (Xold, Yold) and ending X and Y coordinates(Xnew, Ynew) held in bytes 5-12 of the message.

The piece movement request message 780 further includes an “Owner UID”field held in bytes 13-14 of the message. The “Owner UID” field holds aUID corresponding to the UID of the client computer that owns the gamepiece that it is desired to move. For example, in a game of checkersbetween a first client computer and a second client computer, the whitegame pieces 746 may be assigned to the first client computer user andthe white game piece coordinates stored in the store 299 of the clientcomputer RAM 266 include an associated “Owner UID” corresponding to theUID of the first client computer. Similarly the black game pieces 748may be assigned to the second client computer and the black game piececoordinates stored in the store 299 of the client computer RAM 266include an associated “Owner UID” corresponding to the UID of the secondclient computer.

The piece movement request message 780 further includes an identifierfield held in bytes 15-16 of the message. The identifier identifies aparticular game piece image that the client computer user wishes tomove. For example, in a game of checkers, the white checkers may beassigned number indices of 1-12 and the black game pieces may beassigned indices of 13-24.

When a user of one of the client computers 14, 16, or 18 attempts tomove one of the game pieces by producing user input signals within theboundary 747 of one of the game piece images 746 and 748, a piecemovement request message 780 is produced and transmitted to the server12. The server 12 receives the message 780 generally in accordance withthe process shown in FIG. 15A.

In this embodiment, when the server receives a “Game” message 359requesting display of game piece images for playing a game, the serverlaunches the game criteria program codes 78, which direct themicroprocessor 52 to wait for piece movement request messages 780 to bereceived from the client computers playing the game. The game criteriaprogram codes 78 additionally directs the microprocessor 52 to storegame piece position coordinates in the game data store 109 for keepingtrack of the game piece image position coordinates. When the game isinitiated by the “Game” message 359, the game data store is loaded withinitial position coordinates of the game piece images.

When the server 12 receives piece movement request messages 780, thegame criteria program codes direct the microprocessor 52 to determinewhether the piece movement request message meets a criterion associatedwith rules of the game being played. For example, if the server receivesa piece movement request message 780 having an Owner UID held in bytes13-14 that does not correspond to the UID held in bytes 3-4 of themessage, then the message represents an attempt by a client computeruser to move a game piece that has been assigned to another clientcomputer user, and the server ignores the piece movement requestmessage.

The server 12 may also compute a desired move magnitude represented bythe X and Y coordinates held in the bytes 5-8 of the message 780 anddetermine whether the piece movement request meets a movement criterionassociated with the game being played. Similarly, the server 12 mayenforce other game rules by determining whether the piece movementrequest message represents a move that meets a criterion for the gamepiece identified by the identifier held in bytes 15-16 of the message780.

When the piece movement message 780 meets the criterion, the gamecriteria program codes 78 directs the microprocessor 52 to produce agame piece movement message, which in this embodiment has the sameformat as the message 780. The piece movement message is then loadedinto the shared buffer 88 and transmitted to the client computers inaccordance with the processes 580 and 597 shown in FIG. 16 and FIG. 17respectively.

Still referring to FIG. 24, in another embodiment, desired game pieceactions may be represented by a game piece action message showngenerally at 782. The piece action messages 782 are transmitted by theclient computers 14, 16, and 18 to the server 12 in response to userinput signals representing desired game piece actions. For example,actuation of a mouse actuator button (e.g. a right mouse button) maypresent the user with a list of options associated with the game piece.In a card game, for example, the options may include flipping the cardto show the face or the back of the card, making the card private suchthat other users are prevented from viewing flipping the card etc. In agame of chess, the options may include a selection of a piece whenpromoting a pawn that has reached the eighth rank of the chessboard, forexample.

The piece action request message 782 is a persistent message having amessage identifier of 7. The piece action request message 782 representsa requested action and includes an “Owner UID” field held in bytes 5-6of the message. The “Owner UID” field holds a UID corresponding to theUID of the client computer that owns the game piece that it is desiredto act upon. The game piece action request message 782 further includesthe identifier field held in bytes 7-8 of the message, which identifiesa particular game piece image that the client computer user wishes toact upon.

The piece action request message 782 also includes an action type fieldheld in byte 9 of the message. The action type field holds an actionindicator index, for example, “flip”, “private” or “public” for a gameof cards.

The game criteria program codes 78 on the server processor circuit 50direct the microprocessor 52 to determine whether the piece actionrequest message 782 meets a criterion associated with rules of the gamebeing played. For example if a game piece action request to flip a cardincludes a UID and Owner UID that are different, and the game piece haspreviously been designated as “private” by the owner, then the actionrequest will not be processed by the server and not transmitted toclient computers.

When the piece action request message 782 received at the server meetsthe criteria, the game criteria program codes 78 directs themicroprocessor 52 to produce a piece action message representing theaction. In this embodiment the piece action message has the same formatas the message 782 and is transmitted to the client computers asdescribed above.

Intercepting Communications

Referring to FIG. 25, a system for intercepting multiple-partycommunications in accordance with an embodiment of the invention isshown generally at 800. The system 800 includes the server 12 and aplurality of client computers 14, 16, and 18, such as those shown inFIG. 1.

In this embodiment, the system 800 further includes a designated clientcomputer 802, which has a display 804 for displaying content. Thedesignated client computer 802 communicates with the server 12 throughthe network 20. The designated client computer 802 also has a pointingdevice 806 and a character input device 808 for producing user inputsignals.

In one embodiment the designated client computer 802 is used by a lawfulintercept authority to access and/or intercept multiple-partycommunications. In general, when permitting lawful intercept or accessto private communications, it is important to only authorize such accessto a lawful intercept authority. Authorizing the designated clientcomputer 802 may involve authenticating a user of the designated clientcomputer. Accordingly the system 800 may optionally include anauthentication server 810 for authenticating a user of the designatedclient computer 802. The authentication server 810 generally storesusernames, passwords, and/or other user information and provides anauthentication indicator to the server 12 when credentials supplied by auser have been validated by the authentication server. Theauthentication server 810 may implement a Remote Authentication Dial-InUser Service (RADIUS) protocol, for example. Alternatively the server 12may provide such authentication functions. In some embodiments theauthentication server 810 may further provide authentication servicesfor authenticating users of the client computers 14, 16, and/or 18.

In other embodiments the designated client computer 802 may be locatedin a secure controlled environment and the client computer may beauthorized for access by users who have access to the secure controlledenvironment.

In general, the designated client computer 802 may be implemented usingthe processor circuit 260 shown in FIG. 9 and the user interface 470shown in FIG. 11. The designated client computer 802 generally operatesin essentially the same way as the other client computers 14, 16 and 18.The designated client computers in a multiple-party communication areidentified by the “SilentFlag” 212 in the client table entry 200 shownin FIG. 7.

Intercept Web Page

Referring to FIG. 26, a screenshot of a web page displayed on thedesignated client computer 802 when the designated client computer firstconnects to the server 12 is shown generally at 820. When the designatedclient computer 802 transmits a request for the web page 820 to theserver 12, the communication manager program codes 70 direct themicroprocessor 52 of the server processor circuit 50 shown in FIG. 2 toread data representing a web page from the web page store 102 of theserver processor circuit hard drive 58 and to transmit the data throughthe network 20 to the designated client computer. In general, therequest from the designated client computer 802 is generated by aninternet browser application running on the designated client computer802 and when web page data is received the web page 820 is displayed inan internet browser window on the display 804.

The web page 820 includes a “username” field 822, a “password” field824, and an “OK” button 826. When a user of the designated clientcomputer 802 enters their username in the “username” field 822, enterstheir password in the “password” field 824, and clicks on the “OK”button 826, a message including the username and password credentials istransmitted to the server 12 (or to the authentication server 810, ifprovided). If the user credentials are authenticated by the server 12(or the authentication server 810), then the designated client computeris permitted access to communication manager functions provided forusers of the designated client computer 802. The communication managerprogram codes 70 then direct the microprocessor 52 to read datarepresenting a saved communication pages web page from the web pagestore 102 and to transmit the data to the designated client computer802.

Referring to FIG. 27, a screenshot of the saved communication pages webpage is shown generally at 840. The web page 840 includes a “list savedcommunications” button 842, and a “list active communications” button844.

Intercept of Active Multiple-Party Communications

When the user of the designated client computer 802 clicks on the “listactive communications” button 844, the blocks of code 232, 234, 235 and236, shown in FIG. 8 are executed as described earlier, causing themicroprocessor 52 to read entries from the communication table 80 and todisplay certain fields in a table 846 on the saved communication pagesweb page 840. The table 846 includes a first column 848 listing amultiple-party communication sequence number (1, 2, 3 for example), asecond column 850 listing the communication name from the“CommunicationName” field 184, and a third column 852 listing thecommunication type. In this embodiment the third column 852 is includedto indicate to a user whether multiple-party communications are “free”or “password” type communications, however the user is able to join“password” type communications whether or not they are in possession ofthe communication password.

The table 846 also includes a fourth column 854, listing a number ofclient computer users involved in each respective multiple-partycommunication. In general, fields in at least one of the columns in thetable 846 have associated hyperlink properties, which facilitateselection of a particular multiple-party communication listed in thedisplay table by the user clicking on, for example, a hyperlinkedcommunication name. When the user clicks on a hyperlink, an HTTP messageidentifying the multiple-party communication is generated andtransmitted to the server processor circuit 50.

Referring to FIG. 28, a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to permit the designated clientcomputer 802 to intercept messages being communicated in an activemultiple-party communication is shown generally at 880.

The process begins at 882 when a HTTP message is received from thedesignated client computer 802 identifying a multiple-partycommunication selected for intercept by the user of the designatedclient computer 802. The HTTP message includes the communicationidentifier (“CID”), and/or other associated information identifying themultiple-party communication, such as the communication name, forexample.

Block 883 directs the microprocessor 52 to read the information in theHTTP message received from the designated client computer and to matchthe information to a multiple-party communication in the communicationtable 80. For example, if the HTTP message includes a communicationidentifier, the “CID” is read from the HTTP message and compared withthe values in the “CID” field 182 in the communication table entries 180find the corresponding multiple-party communication. Alternatively, ifthe HTTP message includes a communication name, the communication nameis compared with the values in the “CommunicationName” field 184 in thecommunication table entry 180 to find the corresponding multiple-partycommunication.

Block 884 then directs the microprocessor 52 to generate a new clienttable entry for the designated client computer 802 in the communicationtable 80 corresponding to the CID. Block 884 also directs themicroprocessor 52 to add the new client table entry to the client table90 stored in the RAM 56. In this embodiment the “SilentFlag” 212 shownin FIG. 7 is set to active to identify the client computer as adesignated client computer user (for example a lawful interceptauthority).

When the designated client computer user joins an already activemultiple-party communication, the “CatchUpFlag” 208 in the client tableentry 200 (shown in FIG. 7) is set to not active, such that the userwill be able to view the effect of non-persistent message types (such aspointer movements) in addition to ant persistent changes to thedisplayed content. The client “SentPointer” field 210 is initially setto “nil” and will be set equal to the “StartPointer” 122 once the firstmessage is sent.

Block 886 then directs the microprocessor 52 create server side Rx andTx buffers 92 and 94 for the designated client computer 802. Block 888then directs the microprocessor 52 to cause the network interface 62 ofthe I/O PORT 60 to transmit data representing the user interface 470(shown in FIG. 11) through the network 20 to the designated clientcomputer.

Block 888 then directs the microprocessor 52 to read the user interfacecodes from the user interface store 101 and to cause the networkinterface 62 of the I/O PORT 60 to transmit the user interface codesthrough the network 20 to the designated client computer 802. In thisembodiment, the designated client computer 802 receives the same userinterface program codes as any other client computer user, and operatesin the same manner as any other of the client computers 14, 16, or 18.Accordingly, the designated client computer displays the same userinterface 470 as shown in FIG. 11. However, when the “SilentFlag” 212 isactive, the number of client computers displayed in the field 492 of thestatus bar 490 does not include the designated client computer 802.Accordingly, if for example, a lawful intercept authority hasintercepted the multiple-party communication, the field 492 reflectsonly the number of client computers other than the designated clientcomputer 802 that are in the multiple-party communication, thusproviding anonymity for the lawful intercept authority. Similarly thecolumn 148 in the table 140 shown in FIG. 4, and the column 854 in thetable 846 shown in FIG. 27 do not reflect any designated clientcomputers that may be intercepting the multiple-party communication.

Block 890 then directs the microprocessor 52 to cause all messages inthe shared buffer (including the persistent messages 332, thenon-persistent messages 334, and control messages 336 shown in FIG. 12)to be transmitted through the network interface 62 of the I/O PORT 60 tothe designated client computer 802.

The designated client computer 802 is also able to produce messages inaccordance with the process shown in FIG. 13A-13C and to transmit themessages in accordance with the process shown in FIG. 14. However, aswill be described later herein, some messages received in response touser input from the designated client computer user may be ignored bythe server.

Referring to FIG. 29, a flowchart of blocks of code for directing theserver processor circuit 50 (shown in FIG. 2) to receive messages fromthe designated client computer 802 and each of the client computers 14,16 and 18 is shown generally at 1000. In general, the process 1000includes modifications to the process shown in FIGS. 15A and 15B tohandle messages from the designated client computer 802.

The process begins at 1002 when a message is received at any of the Rxbuffers 92 in the RAM 56. When a message is received, block 1004 directsthe microprocessor 52 to read the “SilentFlag” 212 in the client tableentry corresponding to the Rx buffer. The process continues at block1006, which directs the microprocessor 52 to determine whether the“SilentFlag” 212 for the client is active.

If the “SilentFlag” 212 is active, then the corresponding clientcomputer is a designated client computer (such as a lawful interceptauthority), and the process continues at block 1008. Block 1008 directsthe microprocessor 52 to determine whether the message identifier of thereceived message is 23 or 24, indicating that the lawful interceptauthority wishes to discontinue intercepting the multiple-partycommunication. If the message identifier is 23 or 24, then the processcontinues at block 1010, which directs the microprocessor 52 to removethe designated client computer entry 200 from the client table 90 (shownin FIG. 2) and to delete the Rx and Tx buffers 92 and 94 for thedesignated client computer.

If at block 1008, the message identifier is not 23 or 24, then theprocess continues at block 1012, which directs the microprocessor 52 toignore the message.

If at block 1006, the “SilentFlag” is not active, then the message wasnot from a designated client computer, and the process continues atblock 508 of FIG. 15A, as described above.

Advantageously, the process 1000 shown in FIG. 29 ignores all messagesreceived from the designated client computer that would cause the userinterface 470 (shown in FIG. 11) to reflect user input from thedesignated client computer user. Accordingly, no pointer correspondingto the designated client computer mouse movements will be displayed onany of the client computers and the designated client computer will alsonot be able to cause characters or images to be displayed in the userinterface 470 on any of the client computers.

Advantageously access to active multiple-party communications by adesignated client computer user is facilitated using the same messagesand client computer interface 470 used by the client computers 14, 16and 18. The “SilentFlag” 212 is used at the server 12 to differentiatebetween ordinary users of client computers (e.g. the client computers14, 16, and 18) and designated client computer users.

In general, the intercept functions described above facilitate interceptof active multiple-party communications to facilitate viewing inreal-time of content created by the client computers 14, 16, and 18,including but not limited to images displayed on the display area 472,lines drawn, characters typed, non-persistent pointer movements, andgame piece display and movement.

Designated Client Computer Access to Saved Communications

As described earlier herein, the communication pages are saved in thecommunication page store 104. For intercept purposes, when pages aresaved and then subsequently loaded and content added, subsequentversions of the same page are stored in separate files (i.e. “Page2-1”,“Page2-2” etc as described above). Accordingly, the server communicationpage store 104 facilitates storing, and subsequent replay of meetingcontent in a sequence corresponding to a sequence in which the contentwas created during the communication. Consequently, a lawful interceptauthority, for example, will have access to all content created in themultiple-party communication, even when the content was subsequentlycleared and/or or hidden by display of subsequent content.

Similarly, in embodiments where the shared buffer 88 is implemented ascircular buffer, when buffer reaches a pre-determined limit, oldermessages will be overwritten by the new messages. Accordingly, at a timewhen the “CurrentPointer 124 is about to wrap around in the circularbuffer, the page manager 74 directs the microprocessor 52 to save thecontents of the shared buffer 88 to the communication page store 104.Thus for intercept purposes, no any content will be lost due tooverwriting of old messages in the shared buffer 88.

Referring to FIG. 30, when the user of the designated client computer802 clicks on the “list saved communications” button 842, the blocks ofcode similar to 232, 234, 235 and 236, shown in FIG. 8 are executed asdescribed earlier, causing the microprocessor 52 to read data from thecommunication page store 104 and to display certain fields in a table1062 on the saved communication pages web page 840. The table 1062includes a first column 1064 listing a multiple-party communicationsequence number (1, 2, 3 for example), a second column 1066 listing thecommunication name read from the communication page store 104, and athird column 1068 listing the communication type “Free” or “Password”.

The table 1062 also includes a fourth column 1070, listing a maximumnumber of client computer users involved in each respectivemultiple-party communication, a fifth column 1071 including a start dateand time associated with the communication, and a sixth column 1072listing a duration of the respective multiple-party communications.

Fields in at least one of the columns in the table 1062 have associatedhyperlink properties, which facilitate selection of a particularmultiple-party communication listed in the display table by the userclicking on, for example, a hyperlinked communication name. Thehyperlinked field causes a message including information identifying thesaved multiple-party communication (for example a communication nameand/or filename) to be transmitted to the server 12.

The saved communication pages web page 840 shown in FIG. 30 furtherincludes a playback rate field 1074 for entering a desired playback ratefor saved messages. In this embodiment the playback rate field 1074 isimplemented as a dropdown list, which permits the user to select aplayback rate, such as “2×”, for setting a rate at which messages willbe transmitted to the designated client computer 802.

Referring to FIG. 31, a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to create a communication for thedesignated client computer 802 to view a saved multiple-partycommunication is shown generally at 1030.

The process begins at 1032 when a message requesting access to a savedmultiple-party communication is received from the designated clientcomputer 802. Block 1033 directs the microprocessor 52 to read thecommunication name and/or associated filename included in the requestmessage.

Block 1034 then directs the microprocessor 52 to add a new communicationentry to the communication table 80 and generate a new unique CID forthis communication. Block 1034 also directs the microprocessor 52 to setthe “HiddenFlag” 198 (shown in FIG. 6) to be active, so as to cause thecommunication to be hidden from the client computers 14, 16, and 18.Referring to FIG. 4, multiple-party communications that have theircorresponding “HiddenFlag” 198 set to active are not listed in the table140 when the process 230 (shown in FIG. 8) is initiated. Since thecommunication is hidden, the “CommunicationName” field 184 in thecommunication table entry 180 may be populated with the filename, thecommunication name or a default value.

Referring back to FIG. 31, the process continues at block 1036, whichdirects the microprocessor 52 to instantiate a new client manager forthe communication.

Block 1038 then directs the microprocessor 52 to create a new sharedbuffer 88 (shown in FIG. 2) for the communication and to initialize the“StartPointer” 122 and the “CurrentPointer” 124 (stored in fields 190and 192 respectively of the communication table entry 180) to nil.

Block 1040 then directs the microprocessor 52 to add the designatedclient computer to the client table 90 stored in the RAM 56. The“CatchUpFlag” 208 is set to not active to allow a lawful authority userto see all content created during the multiple-party communication. The“SilentFlag” 212 is also set to active at this point, but since thecommunication is hidden this is not absolutely necessary, but mayprovide additional security against a computer hackers seeking to view asaved multiple-party communication, for example.

The process 1030 continues at block 1042, which directs themicroprocessor 52 to create server side Rx and Tx buffers 92 and 94 forthe designated client computer.

Block 1044 then directs the microprocessor 52 to read web page data fromthe web page store 102 of the hard drive 58, and cause the networkinterface 62 of the I/O PORT 60 to transmit the data representing thesaved communication pages web page 840 through the network 20 to theclient computers.

Block 1046 then directs the microprocessor 52 to read messagescorresponding to a first page of the multiple-party communication from afile having a filename read in block 1033 from the saved communicationpage store 104 on the server hard drive 58 (shown in FIG. 2). Block 1046also directs the microprocessor 52 to load the messages into the sharedbuffer 88 for the communication. The “StartPointer” 122 is set toreference the message store 120 in the shared buffer 88 to which thefirst message was loaded. As the message stores 120 of the shared buffer88 are loaded with subsequent messages read from the page file, the“CurrentPointer” 124 is incremented to reference the last loaded messagestore.

The “StartPointer” 122 is set to reference the first message andsubsequently updated to reference later messages loaded into the sharedbuffer 88.

As described above, the saved communication page store 104 may include aplurality of files for each page created during the multiple-partycommunication. The files represent different and sequential versions ofthe messages in the shared buffer 88 and the files are created the pagemanager 74 when:

-   -   the user changes the current page to the next or previous page;    -   the user opens content from client saved content store 100;    -   the user invokes the ClearScreen function;    -   a last client computer user disconnects from the communication;        and    -   the shared buffer wraps around.

Accordingly, when the designated client computer 802 accesses a savedcommunication the communication content is replayed in sequence startingat the first version of the first page (i.e. “Page1-1”) through allsubsequent versions of the page in sequence. Accordingly, nocommunication content is lost or overwritten, which would cause playedback content to differ from actual content displayed during thecommunication.

Referring to FIG. 32, a flowchart of blocks of code for directing theprocessor circuit 50 (shown in FIG. 2) to transmit messages from thesaved multiple-party communication is shown generally at 1130. Thetransmit messages process is essentially similar to the process 580shown in FIG. 16, except for the inclusion of blocks 1132 to 1138.

If at block 594, the “CatchUpFlag” is active then the process 1130continues at block 1132, which directs the microprocessor 52 todetermine whether the “SilentFlag” 212 is set to active. If the“SilentFlag” 212 is set to active, then the client is a designatedclient computer, and the process continues at block 1134.

Block 1134 directs the microprocessor 52 to determine whether themessage is the first message transmitted to the designated clientcomputer, in which case the process continues at block 1136. Block 1136directs the microprocessor 52 to save the message timestamp for thefirst message as T_(m), and the current server time as T₀, in locations(not shown) in the RAM 56.

The process then continues at block 1138, which directs themicroprocessor 52 to wait until the current server time matches a“Transmit Time” calculated according to the relation:

$\begin{matrix}{{{Transmit}\mspace{14mu} {Time}} = {T_{0} + \frac{{Timestamp} - T_{m}}{PBRate}}} & {{Eqn}\mspace{14mu} 2}\end{matrix}$

where “PBRate” is the playback rate selected by the user at field 1074in FIG. 30.

If at block 1134, the message was the first message then no wait timewill be incurred at block 1138, since the timestamp of the first messageis equal to T_(m). The process then continues at block 592, whichdirects the microprocessor 52 to read a message in the shared buffer 88referenced by the “SentPointer” 126 and to load the message into the Txbuffer 94 corresponding to the designated client computer 802.

If at block 1134, the message was not the first message then the processcontinues at block 1138, which directs the microprocessor 52 to wait fora period of time calculated from Eqn 2, before the process continues atblock 592, as described above.

Since the “CatchUp” flag 208 for the designated client computer 802 isset to not active at block 1040 in FIG. 31 and the “SilentFlag” 212 isactive, all persistent, non-persistent, and control messages will beprocessed in accordance with the codes includes in block 1134-1138 andthen loaded into the server side Tx buffer for transmission to thedesignated client computer 802.

Advantageously, the timestamp associated with each message received fromthe client computers facilitates viewing messages at a playback rate,which matches the rate at which content was created in the originalmultiple-party communication. Furthermore the designated client computeruser may also select a playback rate at the playback rate field 1074 ofthe web page 840 shown in FIG. 30 to cause messages to be displayed atan increased or reduced rate (for example twice the content creationrate), as desired by the designated client computer user.

Advantageously, the user of the designated client computer 802 receivesall persistent and non-persistent messages allowing the user to view allmouse movements by the client computer users in the multiple-partycommunication.

Multiple Server System

Referring to FIG. 33, a system for supporting multiple-partycommunications in accordance with a multiple-server embodiment of theinvention is shown generally at 1170. The system 1170 includes a firstserver 1172, such as the server 12 shown in FIG. 1, and may also includea plurality of client computers 14, 16, and 18, such as those shown inFIG. 1. The system 1170 further includes a second server 1174. In theembodiment shown the first and second servers 1172 and 1174 are bothimplemented using the processor circuit 50 shown in FIG. 2. The firstserver 1172 and the second server 1174 are both in communication withthe network 20.

In general, the first and second servers 1172 and 1174 are configured toprovide server functions as described above in connection with theserver 12 and the server processor circuit 50.

The first and second servers 1172 and 1174 may be located to providemultiple-party communications in specific geographic regions. Forexample, the first server 1172 may be located in Vancouver, Canada forserving North American clients such as the client computers 14 and 16,while the second server 1174 may be located in London, England forserving European clients such as the client computer 18.

In other embodiments the first and second servers 1172 and 1174 may bemembers of a server farm used to provide multiple-party communicationsto a large plurality of clients, and accordingly the first and secondservers may be located proximate a virtual server (not shown) thatprovides load balancing functions. In such embodiments, the server maycomprise a plurality of servers, such as the servers 1172 and 1174.

Multiple Server Operation

In one embodiment, when the process 150 (shown in FIG. 5) is launched tocreate a new multiple-party communication on the first server 1172, thefirst server automatically transmits the communication name, password(if used) to the second server 1174. The first server 1174 also adds thesecond server 1174 to the client table 90 stored in the server RAM 56,and sets the “CatchUpFlag” 208 to not active, which results in thesecond server being transmitted all persistent, non-persistent, andcontrol messages.

In this embodiment, block 164 of the process 150, which transmits theuser interface web page to the client computers, is omitted when addingthe second server 1174 to the multiple-party communication.

When the second server 1174 receives the communication name and passwordfrom the first server 1172, the second server creates a newmultiple-party communication to mirror the multiple-party communicationcreated on the first server.

Referring to FIG. 34, a flowchart of blocks of code for directing thesecond server processor circuit 50 (shown in FIG. 2) to create amirrored multiple-party communication is shown generally at 1200. Theprocess begins at 1202 when a message including a communication name andoptional password is received from the first server 1172. In general,each server 1172 and 1174 maintains a list of other servers in thesystem 1170 and is thus able to distinguish between communications fromthe client computers 14, 16, and/or 18 and communications from otherservers 1172 or 1176 respectively.

Block 1204 then directs the microprocessor 52 to add a new communicationentry 180 (shown in FIG. 6) to the communication table 80 in the RAM 56.The communication identifier (“CID”) field 182 in the communicationtable 80 is set to the unique number assigned by the first server 1172,the “CommunicationName” field 184 is set to the communication namereceived from the first server, the “CommunicationPassword” field 186 isset to the password received from the first server (if provided).

The process continues at block 1206, which directs the microprocessor 52to create a new shared buffer 88 (shown in FIG. 2) for themultiple-party communication, and to initialize the “StartPointer” 122and the “CurrentPointer” 124 (stored in fields 190 and 192 respectivelyof the communication table entry 180) to nil. Block 1206 also directsthe microprocessor 52 to instantiate a page manager for themultiple-party communication by launching the page manager program codesin the store 74 of the program memory 54.

Block 1208 then directs the microprocessor 52 to instantiate a newclient manager for the multiple-party communication by launching theclient manager program codes in the store 72 of the program memory 54.

The process continues at block 1210, which directs the microprocessor 52to generate a new client table 90 in the RAM 56, and to add an entry 200to the client table for the first server 1172. The client useridentifier field (“UID”) 202 is set to a unique number identifying thefirst server 1172. The client IP address field 204 and the client portfield 206 are set to values corresponding to the IP address and port forthe first server 1172. The “CatchUpFlag” 208 is set to not active, whichcauses all persistent, non-persistent, and control messages received bythe second server 1174 to be transmitted to the first server 1172.

The process 1200 then continues at block 1212, which directs themicroprocessor 52 to create server side Rx and Tx buffers 92 and 94 forthe first server 1172.

Advantageously, by causing each of the first and second servers 1172 and1174 to be included as clients in the respective client tables, allpersistent, non-persistent, and control messages received at the firstserver from the client computers 14 and 16 are automatically transmittedto the second server by the process 580 shown in FIG. 16. The secondserver 1174 is essentially treated as any other client computer, in thisrespect.

Similarly, the second server 1174 essentially treats the first server1172 as any other client computer, and inserts the messages receivedfrom the first server into the shared buffer on the second server (inaccordance with the process 500 shown in FIG. 15A).

Similarly, all persistent, non-persistent, and control messages receivedat the second server 1174 from the client computer 18 are transmitted tothe first server 1172. The first server 1172 inserts the messagesreceived from the second server 1174 into the shared buffer on the firstserver. Accordingly the shared buffer on the first server 1172 iscontinuously updated with messages received at the second server 1174and the shared buffer on the second server 1174 is continuously updatedwith messages received at the first server 1172.

Messages received from the first server 1172 at the second server 1174only differ from messages received directly from the client computer 18,in that all messages received from the client computer 18 will have thesame UID 202, while messages received from the first server 1172 mayhave a UID corresponding to either the client computer 14, or the clientcomputer 16.

Client computers, such as the client computer 18, which is in ageographical region that is closer to the second server 1174, connect tothe second server to join the multiple-party communication by launchingthe process 230 shown in FIG. 8 on the second server 1174. Since thesecond server 1174 has created an instance of the multiple-partycommunication, the client computer 18 should be generally unaware thatthey connected to the second server 1174, while the client computers 14and 16 are connected to the first server 1172.

Advantageously, the second server 1174 should be able to provide afaster response to messages received from the client computer 18 thanthe first server 1172. In one embodiment the web page 130 shown in FIG.4 may include server buttons allowing clients select either the firstserver 1172 or the second server 1174 when joining a multiple-partycommunication. In this case the selection of the server is left up tothe user of the client computer 14, 16, or 18.

In other embodiments, the system 1170 may further include a centralserver or a virtual server (not shown) that implements load balancing toredirect a connection from a client computer 14, 16, or 18 to either thefirst server 1172 or the second server 1174, depending on which is ableto provide a faster response. Load balancing techniques are well knownin the art, and may involve evaluating round trip times for each of theservers 1172 and 1174, before selecting a server having the quickestresponse to the client.

Referring back to FIG. 15A, when messages are received from the clientcomputers 14, 16, or 18 in any of the client Rx buffers, block 506causes the messages to be time stamped. In the embodiment shown in FIG.15, the timestamp is appended to the end of the messages (shown in FIG.12). Accordingly, messages transmitted by the second server 1174 to thefirst server 1172 will thus already been time stamped at the secondserver.

Messages received at the first server 1172 from client computers 14 and16 are also time stamped when received at the first server.Consequently, all messages received at the first server 1172 from thesecond server 1174 will include a first timestamp appended by the secondserver and a second timestamp appended by the first server.

In this embodiment, messages received at the first server 1172 areinserted into the shared buffer in ordered time sequence according tothe first timestamp appended to the message by the second server 1174.The second timestamp appended by the first server 1172 when receivingthe message is ignored by the first server, when determining the timeorder in which to insert the messages in the shared buffer.

Similarly, messages from the client computers 14 and 16 received by thefirst server 1172 that are transmitted to the second server 1174 have atimestamp appended to the message, which facilitates determining a timeorder in which these messages should be inserted into the shared bufferon the second server.

Messages transmitted from the first server 1172 to the second server1174 are similarly inserted into the shared buffer on the second serverin time order. The first and second servers 1172 and 1174 may be timesynchronized, for example through a Network Time Protocol, accountingfor any time zone differences that may exist between the geographiclocations of the servers.

Advantageously, inserting messages into the shared buffers in time ordercauses persistent and non-persistent messages from the client computers14, 16, and 18 to be displayed in a time-sequenced order when receivedat the client computers from the first and second servers 1172 and 1174,thus at least partially compensating for network latency between thefirst and second servers. In some embodiments, messages received at eachof the server 1172 and 1174 may be pre-buffered before being insertedinto the respective shared buffers, to compensate for varying networkdelay. For example, when the network latency between the first server1172 and the second server 1174 is approximately 160 milliseconds, apre-buffer memory in the RAM 56 may be configured to have a bufferwindow of approximately 160 milliseconds. When inserting messages intothe shared buffer, the oldest message in the 160 millisecond bufferwindow is copied from the pre-buffer into the shared buffer first.

In yet another embodiment the non-persistent messages from the clientcomputers 14, 16, and 18 may be inserted into the shared buffer as soonas they arrive, while persistent and control messages may be inserted intime ordered sequence, in accordance with their respective timestamps.As will be readily appreciated persistent and control messages thatcause lines, characters and images to be displayed are more important tohave in correct time order than non-persistent messages that onlyindicated relative pointer positions of the client computers 14, 16, and18.

Advantageously, each client computer 14, 16, or 18 generally connects toa server having the quickest round-trip time for transmitting a messagefrom the client and receiving the message back from the server, whichmay be typically about 60 milliseconds. This creates the impression forthe client that the latency between their cursor position and thereceived pointer position is reduced compared to a single-server system,while the same view is provided on the respective displays 15, 17, and19. For example, if the client computer 18 in London connected directlyto the first server 1172 located in Vancouver, then the round-trip timewould be about 160 milliseconds for this client.

Media Relay

In one embodiment the server processor circuit 50 shown in FIG. 2includes codes 76 for causing the processor circuit to effect mediarelay functions.

Referring to FIG. 35, when any of the users of the client computers 14,16, or 18 wishes to communicate with each other via audio and/or videolinks, the server 12 may provide a media relay function. The media relayreceives data representing audio and/or video information from one ofthe client computers (e.g. the client computer 14) and retransmits theaudio/video data to one of the other client computers (e.g. the clientcomputer 16). The audio data may be produced by a voice over internetprotocol (VOIP) software implemented telephone, for example, and thevideo data may be produced by a webcam, for example. The audio/videodata may be formatted to comply with User Datagram Protocol (UDP), orany other suitable network transmission protocol.

Advantageously, the when the server 12 provides media relay functionsfor relaying communications between users, the server transmits thevideo/audio data to the designated client computer 802, thereby allowinga lawful intercept authority to monitor such communications for lawfulintercept purposes. The lawful intercept monitoring may involvereceiving audio or video data representing speech or video images of thecommunication between the users. Alternatively, the lawful interceptauthority may only view intercept related information (IRI) informationindicating that a communications connection was established betweencertain client computers, at a certain time, for example.

While specific embodiments of the invention have been described andillustrated, such embodiments should be considered illustrative of theinvention only and not as limiting the invention as construed inaccordance with the accompanying claims.

What is claimed is:
 1. A method implemented on a plurality of clientcomputers in communication with a server over a computer network, theplurality of client computers each displaying common content on anassociated display area, the method comprising: generating messagesrepresenting user input received at one client computer of the pluralityof client computers, the user input defining content to be shared withthe plurality of client computers; causing the one client computer totransmit the generated messages to the server to elicit transmission ofoutput messages from the server to each of the plurality of clientcomputers, the output messages including information defining thecontent to be shared; and in response to receiving output messages fromthe server at each of the plurality of client computers, displaying theshared content over the common content on the respective display areason each of the plurality of client computers.
 2. The method of claim 1wherein the user input comprises lines drawn and characters typed overthe common content by a user of the one client computer.
 3. The methodof claim 2 wherein each generated message represents a single charactertyped by the user of the one client computer such that transmission ofthe output messages by the server causes the characters to besequentially displayed on each of the plurality of client computers. 4.The method of claim 1 wherein displaying common content comprisesdisplaying one of: web page content associated with a web siteaccessible over the computer network; and content input by users of oneor more of the client computers.
 5. The method of claim 1 whereindisplaying common content comprises displaying data downloaded by eachof the plurality of client computers from a uniform resource locator(URL) elsewhere on the computer network.
 6. The method of claim 1further comprising receiving program codes from the server at each ofthe plurality of client computers, the program codes being operable toprovide functions for generating messages and transmitting messages tothe server to cause content to be shared.
 7. The method of claim 6wherein the program codes comprise one of Java and Flash program codes.8. The method of claim 1 wherein displaying the shared content over thecommon content on the display area on the one client computer is inresponse to receiving output messages from the server at the one clientcomputer, such that the shared content is displayed with a latency thatcorresponds to a latency associated with displaying shared content oneach of the remaining client computers in the plurality of clientcomputers.
 9. A method implemented on a server for interceptingcommunications between a plurality of client computers in communicationwith the server over a computer network, the plurality of clientcomputers each displaying common content associated with a web siteaccessible over the computer network, the method comprising: receivinginput messages at the server from the plurality of client computersrepresenting user input received at the plurality of client computers,the user input defining content to be shared with the plurality ofclient computers; causing the server to produce output messagesrepresenting said user input provided by said input messages; receivinga request at the server from a lawful intercept client computer tointercept communications between the plurality of client computers;permitting the lawful intercept client computer to join thecommunication between the plurality of client computers; causing theserver to transmit the output messages to each of the plurality ofclient computers and the lawful intercept client computer to facilitatedisplay of shared content over the common content on each of theplurality of client computers and the lawful intercept client computer;and causing the server to ignore messages received from the lawfulintercept client computer that would reflect user input from the lawfulintercept client computer over the common content.
 10. The method ofclaim 9 further comprising causing the server to transmit user interfacecodes to the lawful intercept client computer to display a userinterface for viewing the common content and the shared contentassociated with output messages.
 11. The method of claim 9 whereincausing the server to ignore messages received from the lawful interceptclient computer comprises, in response to receiving an input messagefrom the lawful intercept client computer, if the input message does notrepresent a request from the lawful intercept client computer todiscontinue intercepting the communication, discarding the inputmessage.
 12. The method of claim 9 wherein permitting the lawfulintercept client computer to join the communication between theplurality of client computers comprises associating a silent flag withthe lawful intercept client computer, the silent flag indicating to theserver that: input messages received from the lawful intercept clientcomputer should be ignored by the server; and output messages thatupdate a displayed field on the plurality of client computers indicatingthe number of computers that have joined the communication should onlybe based on the plurality of client computers in the communication andshould not include the lawful intercept client computer.
 13. The methodof claim 9 wherein permitting the lawful intercept client computer tojoin the communication comprises permitting the lawful intercept clientcomputer to join the communication following authentication of a user ofthe lawful intercept client computer.